Sep 01 00:56:40 devstack cinder-volume[76087]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 00:56:40 devstack cinder-volume[76087]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 00:56:40 devstack cinder-volume[76087]: we strongly recommend against using it for new projects. Sep 01 00:56:40 devstack cinder-volume[76087]: If you are already using Eventlet, we recommend migrating to a different Sep 01 00:56:40 devstack cinder-volume[76087]: framework. For more detail see Sep 01 00:56:40 devstack cinder-volume[76087]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 00:56:40 devstack cinder-volume[76087]: import eventlet # noqa Sep 01 00:56:43 devstack cinder-volume[76087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76087) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 00:56:43 devstack cinder-volume[76087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76087) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 00:56:43 devstack cinder-volume[76087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76087) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 00:56:44 devstack cinder-volume[76087]: INFO dbcounter [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Registered counter for database cinder Sep 01 00:56:44 devstack cinder-volume[76087]: DEBUG oslo_db.sqlalchemy.engines [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76087) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:56:44 devstack cinder-volume[76087]: DEBUG dbcounter [-] [76087] Writer thread running {{(pid=76087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 00:56:44 devstack cinder-volume[76087]: INFO cinder.rpc [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 00:56:44 devstack cinder-volume[76087]: INFO cinder.rpc [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 00:56:44 devstack cinder-volume[76087]: DEBUG oslo_db.sqlalchemy.engines [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76087) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:56:44 devstack cinder-volume[76087]: INFO cinder.volume.manager [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Determined volume DB was empty at startup. Sep 01 00:56:44 devstack cinder-volume[76087]: DEBUG cinder.volume.manager [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76087) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 00:56:44 devstack cinder-volume[76087]: INFO cinder.volume.manager [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 00:56:44 devstack cinder-volume[76087]: WARNING stevedore.named [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 00:56:44 devstack cinder-volume[76087]: WARNING castellan.key_manager [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 00:56:44 devstack cinder-volume[76087]: WARNING cinder.keymgr.conf_key_mgr [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 00:56:44 devstack cinder-volume[76087]: DEBUG cinder.volume.drivers.lvm [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76087) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 00:56:44 devstack cinder-volume[76087]: DEBUG oslo_concurrency.processutils [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_concurrency.processutils [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] CMD "cinder-rtstool verify" returned: 0 in 0.438s {{(pid=76087) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_db.sqlalchemy.engines [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76087) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:56:45 devstack cinder-volume[76087]: INFO cinder.rpc [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 00:56:45 devstack cinder-volume[76087]: INFO cinder.rpc [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 00:56:45 devstack cinder-volume[76087]: WARNING stevedore.named [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 00:56:45 devstack cinder-volume[76087]: WARNING castellan.key_manager [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 00:56:45 devstack cinder-volume[76087]: INFO cinder.volume.manager [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_db.sqlalchemy.engines [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76087) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:56:45 devstack cinder-volume[76087]: INFO oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Starting 1 workers Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Started child 76231 {{(pid=76087) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Full set of CONF: {{(pid=76087) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] ******************************************************************************** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Configuration options gathered from: {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] ================================================================================ {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] allow_availability_zone_fallback = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] allow_compression_on_image_upload = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76231]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] allowed_direct_url_schemes = [] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] api_rate_limit = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] auth_strategy = keystone {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] az_cache_duration = 3600 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_availability_zone = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_host = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_name = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_stats_polling_interval = 60 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backup_api_class = cinder.backup.api.API {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backup_name_template = backup-%s {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backup_use_same_host = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backup_use_temp_snapshot = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] chap_password = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] chap_username = {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cinder_internal_tenant_project_id = 257b63d2175d475ca7e29d0fecc1c7d9 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cinder_internal_tenant_user_id = d4eb1cc835904139a2cb105a68e04cba {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cloned_volume_same_az = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cluster = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] compression_format = gzip {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] compute_api_class = cinder.compute.nova.API {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] config_dir = [] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] config_source = [] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] control_exchange = openstack {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] debug = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] default_availability_zone = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] default_group_type = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] default_volume_type = lvmdriver-1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] disk_geometry = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] driver_client_cert = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] driver_client_cert_key = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] driver_data_namespace = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] driver_ssl_cert_path = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] driver_ssl_cert_verify = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] driver_use_ssl = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] enable_force_upload = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] enable_new_services = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] enable_unsupported_driver = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] enforce_multipath_for_image_xfer = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] filter_function = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance_api_insecure = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance_api_servers = ['http://192.168.122.211/image'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance_api_ssl_compression = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance_ca_certificates_file = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance_catalog_info = image:glance:publicURL {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance_certfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance_keyfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance_num_retries = 3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance_request_timeout = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] goodness_function = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] graceful_shutdown_timeout = 5 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] group_api_class = cinder.group.api.API {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] host = devstack {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] image_compress_on_upload = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] image_conversion_address_space_limit = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] image_conversion_cpu_limit = 60 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] image_conversion_disable = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] image_upload_use_cinder_backend = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] image_upload_use_internal_tenant = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] image_volume_cache_enabled = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] image_volume_cache_max_count = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] image_volume_cache_max_size_gb = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] init_host_max_objects_retrieval = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] instance_format = [instance: %(uuid)s] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] iscsi_target_flags = {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] iscsi_write_cache = on {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] iser_helper = tgtadm {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] iser_ip_address = 192.168.122.211 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] iser_port = 3260 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] log_color = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] log_config_append = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] log_dir = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] log_file = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] log_options = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] log_rotate_interval = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] log_rotate_interval_type = days {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] log_rotation_type = none {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] max_age = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] max_logfile_count = 30 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] max_logfile_size_mb = 200 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] max_over_subscription_ratio = 20.0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] message_reap_interval = 86400 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] message_ttl = 2592000 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] migration_create_volume_timeout_secs = 300 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] monkey_patch = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] monkey_patch_modules = [] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] my_ip = 192.168.122.211 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] no_snapshot_gb_quota = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] num_iser_scan_tries = 3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] num_shell_tries = 3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] num_volume_device_scan_tries = 3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] nvmeof_conn_info_version = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] nvmet_ns_id = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] nvmet_port_id = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] osapi_max_limit = 1000 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] osapi_volume_ext_list = [] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76231]: INFO cinder.volume.manager [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] osapi_volume_listen_port = 8776 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] osapi_volume_use_ssl = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] osapi_volume_workers = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] per_volume_size_limit = -1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] periodic_fuzzy_delay = 60 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] periodic_interval = 60 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] public_endpoint = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] publish_errors = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] quota_backup_gigabytes = 1000 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] quota_backups = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] quota_gigabytes = 1000 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] quota_groups = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] quota_snapshots = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] quota_volumes = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] rate_limit_burst = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] rate_limit_except_level = CRITICAL {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] rate_limit_interval = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] reinit_driver_count = 3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] replication_device = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] report_discard_supported = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] report_interval = 120 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] reservation_clean_interval = 86400 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] reservation_expire = 86400 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] reserved_image_namespaces = [] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] reserved_percentage = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] rpc_response_timeout = 120 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] run_external_periodic_tasks = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] scst_target_driver = iscsi {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] scst_target_iqn_name = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] service_down_time = 720 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] shell_completion = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] snapshot_name_template = snapshot-%s {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] snapshot_same_host = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] split_loggers = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] state_path = /opt/stack/data/cinder {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] storage_availability_zone = nova {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] storage_protocol = iSCSI {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] syslog_log_facility = LOG_USER {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] target_helper = lioadm {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] target_ip_address = 192.168.122.211 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] target_port = 3260 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] target_protocol = iscsi {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] target_secondary_ip_addresses = [] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] trace_flags = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] transport_url = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] until_refresh = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] use_chap_auth = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] use_default_quota_class = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] use_journal = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] use_json = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] use_multipath_for_image_xfer = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] use_stderr = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] use_syslog = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] verify_glance_signatures = enabled {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_api_class = cinder.volume.api.API {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_backend_name = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_clear = zero {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_clear_ionice = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_clear_size = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_copy_bps_limit = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_dd_blocksize = 1M {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_name_template = volume-%s {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_service_inithost_offload = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volume_usage_audit_period = month {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] zoning_mode = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_concurrency.disable_process_locking = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.auth_section = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.auth_type = password {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.auth_version = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.cache = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.certfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.include_service_catalog = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.insecure = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.interface = public {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.keyfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_password = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcache_username = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.region_name = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.service_type = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.211/identity {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.backend = dogpile.cache.null {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.backend_argument = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.backend_expiration_time = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.config_prefix = cache.oslo {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.debug_cache_backend = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.enable_retry_client = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.enable_socket_keepalive = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.enabled = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.expiration_time = 600 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.hashclient_retry_attempts = 2 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.memcache_dead_retry = 300 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.memcache_pool_maxsize = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.memcache_sasl_enabled = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.password = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.proxies = [] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.redis_db = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.redis_server = localhost:6379 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.retry_attempts = 2 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.retry_delay = 0.0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.socket_keepalive_count = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.socket_keepalive_idle = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.socket_keepalive_interval = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.socket_timeout = 1.0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.tls_allowed_ciphers = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.tls_cafile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.tls_certfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.tls_enabled = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.tls_keyfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cache.username = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] coordination.backend_url = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.asyncio_connection = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.asyncio_slave_connection = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.backend = sqlalchemy {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.connection = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.connection_debug = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.connection_parameters = {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.connection_recycle_time = 3600 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.connection_trace = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.db_inc_retry_interval = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.db_max_retries = 20 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.db_max_retry_interval = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.db_retry_interval = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.max_overflow = 50 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.max_pool_size = 5 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.max_retries = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.mysql_wsrep_sync_wait = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.pool_timeout = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.retry_interval = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.slave_connection = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.sqlite_synchronous = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.synchronous_reader = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] database.use_db_reconnect = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_tracing.insecure = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler.connection_string = messaging:// {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler.enabled = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler.es_doc_type = notification {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler.es_scroll_size = 10000 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler.es_scroll_time = 2m {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler.filter_error_trace = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler.hmac_keys = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler.sentinel_service_name = mymaster {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler.socket_timeout = 0.1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler.trace_requests = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler.trace_sqlalchemy = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler_jaeger.process_tags = {} {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler_jaeger.service_name_prefix = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] profiler_otlp.service_name_prefix = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_policy.enforce_new_defaults = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_policy.policy_default_rule = default {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_policy.policy_file = policy.yaml {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] privsep_osbrick.group = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] privsep_osbrick.helper_command = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] privsep_osbrick.user = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cinder_sys_admin.group = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cinder_sys_admin.helper_command = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack sudo[76238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 00:56:45 devstack sudo[76238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] cinder_sys_admin.user = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] service_user.auth_section = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] service_user.auth_type = password {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] service_user.cafile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] service_user.certfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] service_user.collect_timing = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] service_user.insecure = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] service_user.keyfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] service_user.send_service_user_token = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] service_user.split_loggers = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] service_user.timeout = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance.auth_section = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance.auth_type = password {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance.certfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance.collect_timing = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance.insecure = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance.keyfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance.region_name = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance.split_loggers = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] glance.timeout = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.backend_availability_zone = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.chap_password = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.chap_username = {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.disk_geometry = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.driver_client_cert = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.driver_client_cert_key = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.driver_data_namespace = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.driver_use_ssl = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.extra_capabilities = {} {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.filter_function = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.goodness_function = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.iscsi_target_flags = {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.iscsi_write_cache = on {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.iser_helper = tgtadm {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.iser_ip_address = 192.168.122.211 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.iser_port = 3260 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.lvm_share_target = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.lvm_type = auto {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.num_shell_tries = 3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.replication_device = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.report_discard_supported = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.reserved_percentage = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.target_helper = tgtadm {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.target_ip_address = 192.168.122.211 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.target_port = 3260 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.target_protocol = iscsi {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.trace_flags = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.unique_fqdn_network = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:45 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.use_chap_auth = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.volume_backend_name = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.volume_clear = zero {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.volume_clear_ionice = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.volume_clear_size = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_reports.file_event_handler = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_reports.log_dir = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.backend_host = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.chap_password = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.chap_username = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.disk_geometry = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.driver_client_cert = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.extra_capabilities = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.filter_function = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.goodness_function = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.iser_helper = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.iser_ip_address = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.iser_port = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.lvm_share_target = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.lvm_type = auto {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.num_shell_tries = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.replication_device = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.report_discard_supported = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.reserved_percentage = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.scst_target_driver = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.storage_protocol = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.target_helper = lioadm {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.target_ip_address = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.target_port = 3260 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.trace_flags = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.use_chap_auth = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.volume_clear = zero {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.volume_clear_size = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] lvmdriver-1.volumes_dir = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.ssl = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_notifications.driver = [] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_notifications.retry = -1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] key_manager.fixed_key = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.barbican_api_version = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.barbican_endpoint = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.barbican_endpoint_type = public {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.barbican_region_name = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.cafile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.certfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.collect_timing = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.insecure = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.keyfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.number_of_retries = 60 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.retry_delay = 1 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.send_service_user_token = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.split_loggers = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.timeout = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.verify_ssl = True {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican.verify_ssl_path = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican_service_user.auth_section = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican_service_user.auth_type = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican_service_user.cafile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican_service_user.certfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican_service_user.collect_timing = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican_service_user.insecure = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican_service_user.keyfile = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican_service_user.split_loggers = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] barbican_service_user.timeout = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.approle_role_id = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.approle_secret_id = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.auth_method = approle {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.auth_path = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.kv_mountpoint = secret {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.kv_path = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.kv_version = 2 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.namespace = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.root_token_id = **** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.ssl_ca_crt_file = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.timeout = 60.0 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.token_file = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.token_role = None {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.use_ssl = False {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:56:46 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] ******************************************************************************** {{(pid=76087) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 00:56:46 devstack sudo[76238]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:46 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.356s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:46 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:46 devstack sudo[76263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:56:46 devstack sudo[76263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:46 devstack sudo[76263]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:46 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.338s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:46 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:56:46 devstack cinder-volume[76231]: INFO cinder.brick.local_dev.lvm [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 00:56:46 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:46 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:46 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:46 devstack sudo[76424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:56:46 devstack sudo[76424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:46 devstack sudo[76424]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:46 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:46 devstack cinder-volume[76231]: DEBUG cinder.brick.local_dev.lvm [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76231) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 00:56:46 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:46 devstack sudo[76523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:56:46 devstack sudo[76523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:47 devstack sudo[76523]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:47 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.493s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:47 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:47 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:47 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:47 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:56:47 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:47 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:47 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:47 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:47 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:47 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:47 devstack sudo[76845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 00:56:47 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:47 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:47 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.247s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:47 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:47 devstack sudo[76848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:56:47 devstack sudo[76848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:48 devstack sudo[76848]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:48 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:48 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:48 devstack sudo[76932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:56:48 devstack sudo[76932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:48 devstack sudo[76932]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:48 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:48 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:48 devstack sudo[76936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:56:48 devstack sudo[76936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:48 devstack sudo[76936]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:48 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:48 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:48 devstack sudo[76978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:56:48 devstack sudo[76978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:49 devstack sudo[76978]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:49 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.313s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:49 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:49 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:49 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:49 devstack sudo[77035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:56:49 devstack sudo[77035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:49 devstack sudo[77035]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:49 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:49 devstack cinder-volume[76231]: INFO cinder.volume.drivers.lvm [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 00:56:49 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:49 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:49 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:49 devstack sudo[77039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:56:49 devstack sudo[77039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:49 devstack sudo[77039]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:49 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:49 devstack cinder-volume[76231]: DEBUG cinder.volume.drivers.lvm [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Updating volume stats {{(pid=76231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:56:49 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:49 devstack sudo[77042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:56:49 devstack sudo[77042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:50 devstack sudo[77042]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:50 devstack sudo[77045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:56:50 devstack sudo[77045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:50 devstack sudo[77045]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:50 devstack sudo[77048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:56:50 devstack sudo[77048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:50 devstack sudo[77048]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:50 devstack sudo[77051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:56:50 devstack sudo[77051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:50 devstack sudo[77051]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:50 devstack cinder-volume[76231]: INFO cinder.volume.driver [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Driver hasn't implemented _init_vendor_properties() Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG cinder.volume.driver [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76231) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG oslo_db.sqlalchemy.engines [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76231) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG dbcounter [-] [76231] Writer thread running {{(pid=76231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG cinder.db.api [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Building query based on filter {{(pid=76231) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG cinder.image.image_utils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76231) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 00:56:50 devstack cinder-volume[76231]: INFO cinder.keymgr.migration [None req-307e0cf3-85f4-4b29-ae23-a0f97d15db87 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG cinder.volume.drivers.lvm [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Updating volume stats {{(pid=76231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:56:50 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:50 devstack sudo[77055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:56:50 devstack sudo[77055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:51 devstack sudo[77055]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:51 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:51 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:51 devstack sudo[77060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:56:51 devstack sudo[77060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:51 devstack sudo[77060]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:51 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:51 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:51 devstack sudo[77064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:56:51 devstack sudo[77064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:51 devstack sudo[77064]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:51 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:51 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:51 devstack sudo[77067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:56:51 devstack sudo[77067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:52 devstack sudo[77067]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:52 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:52 devstack cinder-volume[76231]: DEBUG cinder.manager [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Notifying Schedulers of capabilities ... {{(pid=76231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:56:52 devstack cinder-volume[76231]: INFO cinder.volume.manager [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Driver initialization completed successfully. Sep 01 00:56:52 devstack cinder-volume[76231]: INFO cinder.manager [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Initiating service 2 cleanup Sep 01 00:56:52 devstack cinder-volume[76231]: INFO cinder.manager [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Service 2 cleanup completed. Sep 01 00:56:52 devstack cinder-volume[76231]: DEBUG cinder.service [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Creating RPC server for service cinder-volume {{(pid=76231) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 00:56:52 devstack cinder-volume[76231]: DEBUG cinder.service [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76231) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 00:56:52 devstack cinder-volume[76231]: INFO cinder.volume.manager [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 00:56:52 devstack cinder-volume[76231]: DEBUG cinder.volume.drivers.lvm [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Updating volume stats {{(pid=76231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:56:52 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:52 devstack sudo[77070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:56:52 devstack sudo[77070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:52 devstack sudo[77070]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:52 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:52 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:52 devstack sudo[77075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:56:52 devstack sudo[77075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:52 devstack sudo[77075]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:52 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:52 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:52 devstack sudo[77081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:56:52 devstack sudo[77081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:53 devstack sudo[77081]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:53 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:53 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:56:53 devstack sudo[77084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:56:53 devstack sudo[77084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:56:53 devstack sudo[77084]: pam_unix(sudo:session): session closed for user root Sep 01 00:56:53 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:56:53 devstack cinder-volume[76231]: INFO cinder.volume.manager [None req-22ae0f35-5742-46ce-8fe5-c533c1cd9e4f None None] Driver post RPC initialization completed successfully. Sep 01 00:56:55 devstack cinder-volume[76087]: DEBUG dbcounter [-] [76087] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76087) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:56:58 devstack cinder-volume[76231]: DEBUG oslo_service.periodic_task [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running periodic task VolumeManager._thread_info {{(pid=76231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:56:58 devstack cinder-volume[76231]: DEBUG cinder.volume.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] thread count: 6 {{(pid=76231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:56:58 devstack cinder-volume[76231]: DEBUG cinder.volume.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] thread info: [<_MainThread(MainThread, started 140622293487744)>, , , , , ] {{(pid=76231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:57:03 devstack cinder-volume[76231]: DEBUG dbcounter [-] [76231] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:57:03 devstack cinder-volume[76231]: DEBUG dbcounter [-] [76231] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:57:58 devstack cinder-volume[76231]: DEBUG oslo_service.periodic_task [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:57:58 devstack cinder-volume[76231]: DEBUG cinder.volume.drivers.lvm [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Updating volume stats {{(pid=76231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:57:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:57:58 devstack sudo[79190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:57:58 devstack sudo[79190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:57:58 devstack sudo[79190]: pam_unix(sudo:session): session closed for user root Sep 01 00:57:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:57:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:57:58 devstack sudo[79194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:57:58 devstack sudo[79194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:57:58 devstack sudo[79194]: pam_unix(sudo:session): session closed for user root Sep 01 00:57:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:57:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:57:58 devstack sudo[79197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:57:58 devstack sudo[79197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:57:59 devstack sudo[79197]: pam_unix(sudo:session): session closed for user root Sep 01 00:57:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:57:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:57:59 devstack sudo[79200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:57:59 devstack sudo[79200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:57:59 devstack sudo[79200]: pam_unix(sudo:session): session closed for user root Sep 01 00:57:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:57:59 devstack cinder-volume[76231]: DEBUG cinder.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Notifying Schedulers of capabilities ... {{(pid=76231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:57:59 devstack cinder-volume[76231]: DEBUG oslo_service.periodic_task [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running periodic task VolumeManager._thread_info {{(pid=76231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:57:59 devstack cinder-volume[76231]: DEBUG cinder.volume.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] thread count: 6 {{(pid=76231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:57:59 devstack cinder-volume[76231]: DEBUG cinder.volume.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] thread info: [<_MainThread(MainThread, started 140622293487744)>, , , , , ] {{(pid=76231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:58:58 devstack cinder-volume[76231]: DEBUG oslo_service.periodic_task [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:58:58 devstack cinder-volume[76231]: DEBUG cinder.volume.drivers.lvm [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Updating volume stats {{(pid=76231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:58:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:58:58 devstack sudo[82558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:58:58 devstack sudo[82558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:58:58 devstack sudo[82558]: pam_unix(sudo:session): session closed for user root Sep 01 00:58:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:58:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:58:58 devstack sudo[82562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:58:58 devstack sudo[82562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:58:58 devstack sudo[82562]: pam_unix(sudo:session): session closed for user root Sep 01 00:58:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:58:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:58:58 devstack sudo[82570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:58:58 devstack sudo[82570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:58:59 devstack sudo[82570]: pam_unix(sudo:session): session closed for user root Sep 01 00:58:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:58:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:58:59 devstack sudo[82573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:58:59 devstack sudo[82573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:58:59 devstack sudo[82573]: pam_unix(sudo:session): session closed for user root Sep 01 00:58:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:58:59 devstack cinder-volume[76231]: DEBUG cinder.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Notifying Schedulers of capabilities ... {{(pid=76231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:58:59 devstack cinder-volume[76231]: DEBUG oslo_service.periodic_task [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running periodic task VolumeManager._thread_info {{(pid=76231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:58:59 devstack cinder-volume[76231]: DEBUG cinder.volume.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] thread count: 6 {{(pid=76231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:58:59 devstack cinder-volume[76231]: DEBUG cinder.volume.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] thread info: [<_MainThread(MainThread, started 140622293487744)>, , , , , ] {{(pid=76231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:59:03 devstack cinder-volume[76231]: DEBUG dbcounter [-] [76231] Writing DB stats cinder:SELECT=1 {{(pid=76231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:59:03 devstack cinder-volume[76231]: DEBUG dbcounter [-] [76231] Writing DB stats cinder:UPDATE=1 {{(pid=76231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:59:58 devstack cinder-volume[76231]: DEBUG oslo_service.periodic_task [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:59:58 devstack cinder-volume[76231]: DEBUG cinder.volume.drivers.lvm [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Updating volume stats {{(pid=76231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:59:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:59:58 devstack sudo[84674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:59:58 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:59:58 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root Sep 01 00:59:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:59:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:59:58 devstack sudo[84682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:59:58 devstack sudo[84682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:59:58 devstack sudo[84682]: pam_unix(sudo:session): session closed for user root Sep 01 00:59:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:59:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:59:58 devstack sudo[84708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:59:58 devstack sudo[84708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:59:59 devstack sudo[84708]: pam_unix(sudo:session): session closed for user root Sep 01 00:59:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:59:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:59:59 devstack sudo[84713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:59:59 devstack sudo[84713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:59:59 devstack sudo[84713]: pam_unix(sudo:session): session closed for user root Sep 01 00:59:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:59:59 devstack cinder-volume[76231]: DEBUG cinder.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Notifying Schedulers of capabilities ... {{(pid=76231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:59:59 devstack cinder-volume[76231]: DEBUG oslo_service.periodic_task [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running periodic task VolumeManager._thread_info {{(pid=76231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:59:59 devstack cinder-volume[76231]: DEBUG cinder.volume.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] thread count: 6 {{(pid=76231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:59:59 devstack cinder-volume[76231]: DEBUG cinder.volume.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] thread info: [<_MainThread(MainThread, started 140622293487744)>, , , , , ] {{(pid=76231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:00:58 devstack cinder-volume[76231]: DEBUG oslo_service.periodic_task [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:00:58 devstack cinder-volume[76231]: DEBUG cinder.volume.drivers.lvm [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Updating volume stats {{(pid=76231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:00:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:00:58 devstack sudo[85858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:00:58 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:00:58 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root Sep 01 01:00:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:00:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:00:58 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:00:58 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:00:58 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Sep 01 01:00:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:00:58 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:00:58 devstack sudo[85876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:00:58 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:00:59 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root Sep 01 01:00:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:00:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:00:59 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:00:59 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:00:59 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Sep 01 01:00:59 devstack cinder-volume[76231]: DEBUG oslo_concurrency.processutils [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:00:59 devstack cinder-volume[76231]: DEBUG cinder.manager [None req-c5f331e7-b3ff-417a-ab9c-500e84a980ea None None] Notifying Schedulers of capabilities ... {{(pid=76231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:01:03 devstack cinder-volume[76231]: DEBUG dbcounter [-] [76231] Writing DB stats cinder:SELECT=1 {{(pid=76231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:01:03 devstack cinder-volume[76231]: DEBUG dbcounter [-] [76231] Writing DB stats cinder:UPDATE=1 {{(pid=76231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:01:10 devstack cinder-volume[76087]: INFO oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Caught SIGTERM, stopping children Sep 01 01:01:10 devstack cinder-volume[76087]: DEBUG oslo_concurrency.lockutils [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Acquiring lock "singleton_lock" {{(pid=76087) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:01:10 devstack cinder-volume[76087]: DEBUG oslo_concurrency.lockutils [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Acquired lock "singleton_lock" {{(pid=76087) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:01:10 devstack cinder-volume[76087]: DEBUG oslo_concurrency.lockutils [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Releasing lock "singleton_lock" {{(pid=76087) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:01:10 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Stop services. {{(pid=76087) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:01:10 devstack cinder-volume[76087]: DEBUG oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Killing children. {{(pid=76087) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:01:10 devstack cinder-volume[76087]: INFO oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Waiting on 1 children to exit Sep 01 01:01:12 devstack cinder-volume[76231]: DEBUG oslo_concurrency.lockutils [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Acquiring lock "singleton_lock" {{(pid=76231) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:01:12 devstack cinder-volume[76231]: DEBUG oslo_concurrency.lockutils [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Acquired lock "singleton_lock" {{(pid=76231) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:01:12 devstack cinder-volume[76231]: DEBUG oslo_concurrency.lockutils [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Releasing lock "singleton_lock" {{(pid=76231) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:01:12 devstack cinder-volume[76231]: WARNING amqp [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:01:12 devstack cinder-volume[76231]: WARNING amqp [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:01:12 devstack cinder-volume[76087]: INFO oslo_service.backend._eventlet.service [None req-4909dc05-556b-4577-a4c2-04ff26d62a50 None None] Child 76231 exited with status 0 Sep 01 01:01:12 devstack cinder-volume[86258]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:01:12 devstack cinder-volume[86258]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:01:12 devstack cinder-volume[86258]: we strongly recommend against using it for new projects. Sep 01 01:01:12 devstack cinder-volume[86258]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:01:12 devstack cinder-volume[86258]: framework. For more detail see Sep 01 01:01:12 devstack cinder-volume[86258]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:01:12 devstack cinder-volume[86258]: import eventlet # noqa Sep 01 01:01:14 devstack cinder-volume[86258]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86258) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:01:14 devstack cinder-volume[86258]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86258) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:01:14 devstack cinder-volume[86258]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86258) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:01:15 devstack cinder-volume[86258]: INFO dbcounter [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Registered counter for database cinder Sep 01 01:01:15 devstack cinder-volume[86258]: DEBUG oslo_db.sqlalchemy.engines [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86258) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:01:15 devstack cinder-volume[86258]: DEBUG dbcounter [-] [86258] Writer thread running {{(pid=86258) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:01:15 devstack cinder-volume[86258]: INFO cinder.rpc [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:01:15 devstack cinder-volume[86258]: INFO cinder.rpc [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:01:15 devstack cinder-volume[86258]: DEBUG oslo_db.sqlalchemy.engines [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86258) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:01:16 devstack cinder-volume[86258]: INFO cinder.volume.manager [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Determined volume DB was empty at startup. Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG cinder.volume.manager [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86258) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:01:16 devstack cinder-volume[86258]: INFO cinder.volume.manager [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:01:16 devstack cinder-volume[86258]: WARNING stevedore.named [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:01:16 devstack cinder-volume[86258]: WARNING castellan.key_manager [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:01:16 devstack cinder-volume[86258]: WARNING cinder.keymgr.conf_key_mgr [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:01:16 devstack cinder-volume[86258]: INFO cinder.volume.manager [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_db.sqlalchemy.engines [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86258) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:01:16 devstack cinder-volume[86258]: INFO oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Starting 1 workers Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Started child 86474 {{(pid=86258) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Full set of CONF: {{(pid=86258) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] ******************************************************************************** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Configuration options gathered from: {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] ================================================================================ {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] allow_availability_zone_fallback = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] allow_compression_on_image_upload = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] allowed_direct_url_schemes = [] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] api_rate_limit = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] auth_strategy = keystone {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_availability_zone = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_host = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_name = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_stats_polling_interval = 60 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86474]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backup_api_class = cinder.backup.api.API {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backup_name_template = backup-%s {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backup_use_same_host = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backup_use_temp_snapshot = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] chap_password = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] chap_username = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cinder_internal_tenant_project_id = 257b63d2175d475ca7e29d0fecc1c7d9 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cinder_internal_tenant_user_id = d4eb1cc835904139a2cb105a68e04cba {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cluster = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] compression_format = gzip {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] compute_api_class = cinder.compute.nova.API {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] config_dir = [] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] config_source = [] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] control_exchange = openstack {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] debug = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] default_availability_zone = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] default_group_type = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] default_volume_type = QuobyteHD {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] disk_geometry = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] driver_client_cert = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] driver_client_cert_key = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] driver_data_namespace = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] driver_ssl_cert_path = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] driver_ssl_cert_verify = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] driver_use_ssl = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] enable_new_services = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] enable_unsupported_driver = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] enabled_backends = ['QuobyteHD'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] enforce_multipath_for_image_xfer = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] filter_function = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance_api_insecure = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance_api_servers = ['http://192.168.122.211/image'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance_api_ssl_compression = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance_ca_certificates_file = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance_catalog_info = image:glance:publicURL {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance_certfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance_keyfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance_num_retries = 3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance_request_timeout = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] goodness_function = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] graceful_shutdown_timeout = 5 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] group_api_class = cinder.group.api.API {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] host = devstack {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] image_compress_on_upload = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] image_conversion_address_space_limit = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] image_conversion_cpu_limit = 60 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] image_conversion_disable = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] image_upload_use_cinder_backend = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] image_upload_use_internal_tenant = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] image_volume_cache_enabled = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] image_volume_cache_max_count = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] image_volume_cache_max_size_gb = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] init_host_max_objects_retrieval = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] instance_format = [instance: %(uuid)s] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] iscsi_target_flags = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] iscsi_write_cache = on {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] iser_helper = tgtadm {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] iser_ip_address = 192.168.122.211 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] iser_port = 3260 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] log_color = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] log_config_append = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] log_dir = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] log_file = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] log_options = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] log_rotate_interval = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] log_rotate_interval_type = days {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] log_rotation_type = none {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] max_age = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] max_logfile_count = 30 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] max_logfile_size_mb = 200 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] max_over_subscription_ratio = 20.0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] message_reap_interval = 86400 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] message_ttl = 2592000 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] migration_create_volume_timeout_secs = 300 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] monkey_patch = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] monkey_patch_modules = [] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] my_ip = 192.168.122.211 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] no_snapshot_gb_quota = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86474]: INFO cinder.volume.manager [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG cinder.volume.drivers.remotefs [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86474) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] num_iser_scan_tries = 3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] num_shell_tries = 3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] num_volume_device_scan_tries = 3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] nvmeof_conn_info_version = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] nvmet_ns_id = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] nvmet_port_id = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] osapi_max_limit = 1000 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] osapi_volume_ext_list = [] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] osapi_volume_listen_port = 8776 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] osapi_volume_use_ssl = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] osapi_volume_workers = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] per_volume_size_limit = -1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] periodic_fuzzy_delay = 60 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] periodic_interval = 60 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] public_endpoint = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] publish_errors = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] quota_backup_gigabytes = 1000 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] quota_backups = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] quota_gigabytes = 1000 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] quota_groups = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] quota_snapshots = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] quota_volumes = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] rate_limit_burst = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] rate_limit_except_level = CRITICAL {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] rate_limit_interval = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] reinit_driver_count = 3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] replication_device = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] report_discard_supported = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] report_interval = 120 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] reservation_clean_interval = 86400 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] reservation_expire = 86400 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] reserved_image_namespaces = [] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] reserved_percentage = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] rpc_response_timeout = 120 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] run_external_periodic_tasks = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] scst_target_driver = iscsi {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] scst_target_iqn_name = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] service_down_time = 720 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] shell_completion = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] snapshot_name_template = snapshot-%s {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] split_loggers = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] state_path = /opt/stack/data/cinder {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] storage_availability_zone = nova {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] storage_protocol = iSCSI {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] syslog_log_facility = LOG_USER {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] target_helper = lioadm {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] target_ip_address = 192.168.122.211 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] target_port = 3260 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] target_protocol = iscsi {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] target_secondary_ip_addresses = [] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] trace_flags = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] transport_url = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] until_refresh = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] use_chap_auth = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] use_default_quota_class = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] use_journal = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] use_json = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] use_multipath_for_image_xfer = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] use_stderr = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] use_syslog = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] verify_glance_signatures = enabled {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_api_class = cinder.volume.api.API {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_backend_name = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_clear = zero {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_clear_ionice = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_clear_size = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_copy_bps_limit = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_dd_blocksize = 1M {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_name_template = volume-%s {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_service_inithost_offload = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volume_usage_audit_period = month {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] zoning_mode = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_concurrency.disable_process_locking = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.auth_section = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.auth_type = password {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.auth_version = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.cache = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.certfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.include_service_catalog = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.insecure = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.interface = public {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.keyfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_password = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcache_username = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.region_name = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.service_type = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.211/identity {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.backend = dogpile.cache.null {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.backend_argument = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.backend_expiration_time = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.config_prefix = cache.oslo {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.debug_cache_backend = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.enable_retry_client = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.enable_socket_keepalive = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.enabled = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.expiration_time = 600 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.hashclient_retry_attempts = 2 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.memcache_dead_retry = 300 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.memcache_pool_maxsize = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.memcache_sasl_enabled = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG cinder.volume.drivers.quobyte [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86474) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:01:16 devstack cinder-volume[86474]: WARNING cinder.volume.drivers.quobyte [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:01:16 devstack cinder-volume[86474]: WARNING cinder.volume.drivers.quobyte [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.password = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.proxies = [] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.redis_db = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.redis_server = localhost:6379 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.retry_attempts = 2 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.retry_delay = 0.0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.socket_keepalive_count = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.socket_keepalive_idle = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.socket_keepalive_interval = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.socket_timeout = 1.0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.tls_allowed_ciphers = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.tls_cafile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.tls_certfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.tls_enabled = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Running cmd (subprocess): mount.quobyte {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.tls_keyfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cache.username = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] coordination.backend_url = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.asyncio_connection = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.asyncio_slave_connection = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.backend = sqlalchemy {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.connection = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.connection_debug = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.connection_parameters = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.connection_recycle_time = 3600 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.connection_trace = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.db_inc_retry_interval = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.db_max_retries = 20 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.db_max_retry_interval = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.db_retry_interval = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.max_overflow = 50 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.max_pool_size = 5 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.max_retries = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.mysql_wsrep_sync_wait = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.pool_timeout = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.retry_interval = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.slave_connection = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.sqlite_synchronous = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.synchronous_reader = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] database.use_db_reconnect = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_tracing.insecure = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler.connection_string = messaging:// {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler.enabled = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler.es_doc_type = notification {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler.es_scroll_size = 10000 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler.es_scroll_time = 2m {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler.filter_error_trace = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler.hmac_keys = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler.sentinel_service_name = mymaster {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler.socket_timeout = 0.1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler.trace_requests = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler.trace_sqlalchemy = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler_jaeger.process_tags = {} {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler_jaeger.service_name_prefix = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] profiler_otlp.service_name_prefix = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_policy.enforce_new_defaults = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_policy.policy_default_rule = default {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_policy.policy_file = policy.yaml {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] privsep_osbrick.group = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] privsep_osbrick.helper_command = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] privsep_osbrick.user = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cinder_sys_admin.group = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cinder_sys_admin.helper_command = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] cinder_sys_admin.user = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] service_user.auth_section = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] service_user.auth_type = password {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] service_user.cafile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] service_user.certfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] service_user.collect_timing = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] service_user.insecure = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] service_user.keyfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] service_user.send_service_user_token = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] service_user.split_loggers = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] service_user.timeout = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance.auth_section = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance.auth_type = password {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance.certfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance.collect_timing = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance.insecure = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance.keyfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance.region_name = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance.split_loggers = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] glance.timeout = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.backend_availability_zone = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.chap_password = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.chap_username = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.disk_geometry = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.driver_client_cert = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.driver_client_cert_key = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.driver_data_namespace = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.driver_use_ssl = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.extra_capabilities = {} {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.filter_function = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.goodness_function = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.iscsi_target_flags = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.iscsi_write_cache = on {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.iser_helper = tgtadm {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.iser_ip_address = 192.168.122.211 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.iser_port = 3260 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nas_host = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nas_login = admin {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nas_mount_options = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nas_password = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nas_private_key = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nas_share_path = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.num_shell_tries = 3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.quobyte_volume_url = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.replication_device = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.report_discard_supported = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.reserved_percentage = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.target_helper = tgtadm {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.target_ip_address = 192.168.122.211 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.target_port = 3260 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.target_protocol = iscsi {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.trace_flags = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack quobyte-client[86479]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.unique_fqdn_network = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.use_chap_auth = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.volume_backend_name = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.volume_clear = zero {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.volume_clear_ionice = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.volume_clear_size = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack quobyte-client[86479]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_reports.file_event_handler = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_reports.log_dir = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.backend_availability_zone = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.backend_host = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.chap_password = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.chap_username = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.chiscsi_conf = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.disk_geometry = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.driver_client_cert = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.driver_data_namespace = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.driver_use_ssl = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.extra_capabilities = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.filter_function = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.goodness_function = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.iser_helper = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.iser_ip_address = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.iser_port = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.iser_target_prefix = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nas_host = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nas_login = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nas_mount_options = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nas_password = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nas_private_key = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] CMD "mount.quobyte" returned: 1 in 0.092s {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG cinder.volume.drivers.quobyte [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=86474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nas_share_path = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nas_ssh_port = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.num_shell_tries = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.nvmet_port_id = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86474]: INFO cinder.volume.drivers.quobyte [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 ... Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 -c /etc/quobyte/client-cinder.cfg {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.replication_device = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.report_discard_supported = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.reserved_percentage = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.scst_target_driver = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.storage_protocol = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.target_helper = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.target_ip_address = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.target_port = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.target_prefix = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.target_protocol = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.trace_flags = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.use_chap_auth = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.volume_clear = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.volume_clear_size = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] QuobyteHD.volumes_dir = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.ssl = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_notifications.driver = [] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_notifications.retry = -1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] key_manager.fixed_key = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.barbican_api_version = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.barbican_endpoint = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.barbican_endpoint_type = public {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.barbican_region_name = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.cafile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 -c /etc/quobyte/client-cinder.cfg Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.certfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.collect_timing = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.insecure = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.keyfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.number_of_retries = 60 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.retry_delay = 1 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.send_service_user_token = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.split_loggers = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.timeout = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.verify_ssl = True {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican.verify_ssl_path = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican_service_user.auth_section = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican_service_user.auth_type = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican_service_user.cafile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican_service_user.certfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican_service_user.collect_timing = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican_service_user.insecure = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican_service_user.keyfile = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican_service_user.split_loggers = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] barbican_service_user.timeout = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.approle_role_id = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.approle_secret_id = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.auth_method = approle {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.auth_path = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.kv_mountpoint = secret {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.kv_path = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.kv_version = 2 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.namespace = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.root_token_id = **** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.ssl_ca_crt_file = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.timeout = 60.0 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.token_file = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.token_role = None {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.use_ssl = False {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:16 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] ******************************************************************************** {{(pid=86258) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:01:16 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.449s {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:01:16 devstack cinder-volume[86474]: INFO cinder.volume.drivers.quobyte [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 succeeded Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG cinder.volume.drivers.quobyte [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=86474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.465s {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:01:16 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:01:17 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:01:17 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:01:17 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.247s {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:01:17 devstack cinder-volume[86474]: INFO cinder.volume.driver [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG cinder.volume.driver [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3822937011719, 'free_capacity_gb': 1774.3822937011719, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86474) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG oslo_db.sqlalchemy.engines [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86474) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG dbcounter [-] [86474] Writer thread running {{(pid=86474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG cinder.db.api [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Building query based on filter {{(pid=86474) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG cinder.image.image_utils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86474) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:01:17 devstack cinder-volume[86474]: INFO cinder.keymgr.migration [None req-75c5ee43-3c6c-4680-86e3-ea1364be5f75 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG cinder.volume.drivers.quobyte [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=86474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG cinder.volume.drivers.quobyte [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=86474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:01:17 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:01:17 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:01:17 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.239s {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG cinder.manager [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Notifying Schedulers of capabilities ... {{(pid=86474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:01:17 devstack cinder-volume[86474]: INFO cinder.volume.manager [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Driver initialization completed successfully. Sep 01 01:01:17 devstack cinder-volume[86474]: INFO cinder.manager [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Initiating service 3 cleanup Sep 01 01:01:17 devstack cinder-volume[86474]: INFO cinder.manager [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Service 3 cleanup completed. Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG cinder.service [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Creating RPC server for service cinder-volume {{(pid=86474) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG cinder.service [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86474) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:01:17 devstack cinder-volume[86474]: INFO cinder.volume.manager [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG cinder.volume.drivers.quobyte [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=86474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG cinder.volume.drivers.quobyte [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=86474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:01:17 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:01:17 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:01:17 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:01:18 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Sep 01 01:01:18 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.245s {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:01:18 devstack cinder-volume[86474]: INFO cinder.volume.manager [None req-dddeee77-157c-438d-b60e-ead219d15978 None None] Driver post RPC initialization completed successfully. Sep 01 01:01:22 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-4d975bcc-8428-4988-a443-76ae4c3f499c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:01:22 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-4d975bcc-8428-4988-a443-76ae4c3f499c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:01:22 devstack cinder-volume[86474]: DEBUG cinder.volume.drivers.quobyte [None req-4d975bcc-8428-4988-a443-76ae4c3f499c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=86474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:01:22 devstack cinder-volume[86474]: DEBUG cinder.volume.drivers.quobyte [None req-4d975bcc-8428-4988-a443-76ae4c3f499c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=86474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:01:22 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-4d975bcc-8428-4988-a443-76ae4c3f499c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:01:22 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-4d975bcc-8428-4988-a443-76ae4c3f499c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:01:22 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:01:22 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:01:22 devstack cinder-volume[86258]: INFO oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Caught SIGTERM, stopping children Sep 01 01:01:22 devstack cinder-volume[86258]: DEBUG oslo_concurrency.lockutils [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Acquiring lock "singleton_lock" {{(pid=86258) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:01:22 devstack cinder-volume[86258]: DEBUG oslo_concurrency.lockutils [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Acquired lock "singleton_lock" {{(pid=86258) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:01:22 devstack cinder-volume[86258]: DEBUG oslo_concurrency.lockutils [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Releasing lock "singleton_lock" {{(pid=86258) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:01:22 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Stop services. {{(pid=86258) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:01:22 devstack cinder-volume[86258]: DEBUG oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Killing children. {{(pid=86258) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:01:22 devstack cinder-volume[86258]: INFO oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Waiting on 1 children to exit Sep 01 01:01:23 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Sep 01 01:01:23 devstack cinder-volume[86474]: DEBUG oslo_concurrency.processutils [None req-4d975bcc-8428-4988-a443-76ae4c3f499c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.384s {{(pid=86474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:01:23 devstack cinder-volume[86474]: DEBUG cinder.manager [None req-4d975bcc-8428-4988-a443-76ae4c3f499c None None] Notifying Schedulers of capabilities ... {{(pid=86474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d975bcc-8428-4988-a443-76ae4c3f499c None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d975bcc-8428-4988-a443-76ae4c3f499c None None] Unable to connect to AMQP server on 192.168.122.211:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server [None req-4d975bcc-8428-4988-a443-76ae4c3f499c None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.211:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server method() Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server return _publish( Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server listener(*args) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.211:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 01 01:01:23 devstack cinder-volume[86474]: ERROR oslo_messaging.rpc.server Sep 01 01:01:26 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Acquiring lock "singleton_lock" {{(pid=86474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:01:26 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Acquired lock "singleton_lock" {{(pid=86474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:01:26 devstack cinder-volume[86474]: DEBUG oslo_concurrency.lockutils [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Releasing lock "singleton_lock" {{(pid=86474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:01:26 devstack cinder-volume[86474]: WARNING amqp [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:01:26 devstack cinder-volume[86474]: WARNING amqp [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:01:26 devstack cinder-volume[86258]: INFO oslo_service.backend._eventlet.service [None req-243175d8-a4be-4b7b-ab32-81b2ab3dd9f1 None None] Child 86474 exited with status 0 Sep 01 01:01:26 devstack cinder-volume[86756]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:01:26 devstack cinder-volume[86756]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:01:26 devstack cinder-volume[86756]: we strongly recommend against using it for new projects. Sep 01 01:01:26 devstack cinder-volume[86756]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:01:26 devstack cinder-volume[86756]: framework. For more detail see Sep 01 01:01:26 devstack cinder-volume[86756]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:01:26 devstack cinder-volume[86756]: import eventlet # noqa Sep 01 01:01:29 devstack cinder-volume[86756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86756) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:01:29 devstack cinder-volume[86756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86756) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:01:29 devstack cinder-volume[86756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86756) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:01:30 devstack cinder-volume[86756]: INFO dbcounter [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Registered counter for database cinder Sep 01 01:01:30 devstack cinder-volume[86756]: DEBUG oslo_db.sqlalchemy.engines [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86756) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG dbcounter [-] [86756] Writer thread running {{(pid=86756) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:01:31 devstack cinder-volume[86756]: INFO cinder.rpc [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:01:31 devstack cinder-volume[86756]: INFO cinder.rpc [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_db.sqlalchemy.engines [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86756) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:01:31 devstack cinder-volume[86756]: INFO cinder.volume.manager [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Determined volume DB was empty at startup. Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG cinder.volume.manager [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86756) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:01:31 devstack cinder-volume[86756]: WARNING stevedore.named [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:01:31 devstack cinder-volume[86756]: WARNING castellan.key_manager [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:01:31 devstack cinder-volume[86756]: WARNING cinder.keymgr.conf_key_mgr [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:01:31 devstack cinder-volume[86756]: INFO cinder.volume.manager [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_db.sqlalchemy.engines [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86756) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:01:31 devstack cinder-volume[86756]: INFO oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Starting 1 workers Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Started child 87064 {{(pid=86756) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Full set of CONF: {{(pid=86756) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] ******************************************************************************** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] Configuration options gathered from: {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] ================================================================================ {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] allow_availability_zone_fallback = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] allow_compression_on_image_upload = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] allowed_direct_url_schemes = [] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] api_rate_limit = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] auth_strategy = keystone {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_availability_zone = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_host = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_name = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_stats_polling_interval = 60 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backup_api_class = cinder.backup.api.API {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backup_name_template = backup-%s {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backup_use_same_host = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backup_use_temp_snapshot = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] chap_password = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] chap_username = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[87064]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cinder_internal_tenant_project_id = 257b63d2175d475ca7e29d0fecc1c7d9 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cinder_internal_tenant_user_id = d4eb1cc835904139a2cb105a68e04cba {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cluster = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] compression_format = gzip {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] compute_api_class = cinder.compute.nova.API {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] config_dir = [] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] config_source = [] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] control_exchange = openstack {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] debug = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] default_availability_zone = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] default_group_type = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] default_volume_type = QuobyteHD {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] disk_geometry = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] driver_client_cert = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] driver_client_cert_key = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] driver_data_namespace = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] driver_ssl_cert_path = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] driver_ssl_cert_verify = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] driver_use_ssl = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] enable_new_services = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] enable_unsupported_driver = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] enabled_backends = ['QuobyteHD'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] enforce_multipath_for_image_xfer = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] filter_function = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance_api_insecure = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance_api_servers = ['http://192.168.122.211/image'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance_api_ssl_compression = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance_ca_certificates_file = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance_catalog_info = image:glance:publicURL {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance_certfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance_keyfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance_num_retries = 3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance_request_timeout = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] goodness_function = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] graceful_shutdown_timeout = 5 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] group_api_class = cinder.group.api.API {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] host = devstack {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] image_compress_on_upload = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] image_conversion_address_space_limit = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] image_conversion_cpu_limit = 60 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] image_conversion_disable = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] image_upload_use_cinder_backend = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] image_upload_use_internal_tenant = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] image_volume_cache_enabled = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] image_volume_cache_max_count = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] image_volume_cache_max_size_gb = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] init_host_max_objects_retrieval = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] instance_format = [instance: %(uuid)s] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] iscsi_target_flags = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] iscsi_write_cache = on {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] iser_helper = tgtadm {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] iser_ip_address = 192.168.122.211 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] iser_port = 3260 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] log_color = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] log_config_append = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] log_dir = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] log_file = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] log_options = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] log_rotate_interval = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] log_rotate_interval_type = days {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] log_rotation_type = none {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] max_age = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] max_logfile_count = 30 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] max_logfile_size_mb = 200 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] max_over_subscription_ratio = 20.0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] message_reap_interval = 86400 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] message_ttl = 2592000 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] migration_create_volume_timeout_secs = 300 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] monkey_patch = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] monkey_patch_modules = [] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] my_ip = 192.168.122.211 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] no_snapshot_gb_quota = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] num_iser_scan_tries = 3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] num_shell_tries = 3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] num_volume_device_scan_tries = 3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] nvmeof_conn_info_version = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] nvmet_ns_id = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] nvmet_port_id = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] osapi_max_limit = 1000 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] osapi_volume_ext_list = [] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] osapi_volume_listen_port = 8776 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] osapi_volume_use_ssl = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] osapi_volume_workers = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] per_volume_size_limit = -1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] periodic_fuzzy_delay = 60 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] periodic_interval = 60 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] public_endpoint = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] publish_errors = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87064) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] quota_backup_gigabytes = 1000 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] quota_backups = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] quota_gigabytes = 1000 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] quota_groups = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] quota_snapshots = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] quota_volumes = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] rate_limit_burst = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] rate_limit_except_level = CRITICAL {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] rate_limit_interval = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] reinit_driver_count = 3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] replication_device = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] report_discard_supported = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] report_interval = 120 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] reservation_clean_interval = 86400 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] reservation_expire = 86400 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] reserved_image_namespaces = [] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] reserved_percentage = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] rpc_response_timeout = 120 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] run_external_periodic_tasks = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] scst_target_driver = iscsi {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] scst_target_iqn_name = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] service_down_time = 720 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] shell_completion = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] snapshot_name_template = snapshot-%s {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] split_loggers = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] state_path = /opt/stack/data/cinder {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] storage_availability_zone = nova {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] storage_protocol = iSCSI {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] syslog_log_facility = LOG_USER {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] target_helper = lioadm {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] target_ip_address = 192.168.122.211 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] target_port = 3260 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] target_protocol = iscsi {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] target_secondary_ip_addresses = [] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] trace_flags = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] transport_url = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] until_refresh = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] use_chap_auth = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] use_default_quota_class = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] use_journal = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] use_json = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] use_multipath_for_image_xfer = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] use_stderr = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] use_syslog = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] verify_glance_signatures = enabled {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_api_class = cinder.volume.api.API {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_backend_name = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_clear = zero {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_clear_ionice = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_clear_size = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_copy_bps_limit = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_dd_blocksize = 1M {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_name_template = volume-%s {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_service_inithost_offload = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volume_usage_audit_period = month {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] zoning_mode = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_concurrency.disable_process_locking = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.auth_section = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.auth_type = password {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.auth_version = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.cache = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.certfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.include_service_catalog = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.insecure = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.interface = public {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.keyfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_password = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcache_username = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.region_name = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.service_type = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.211/identity {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.backend = dogpile.cache.null {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.backend_argument = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.backend_expiration_time = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.config_prefix = cache.oslo {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.debug_cache_backend = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.enable_retry_client = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.enable_socket_keepalive = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.enabled = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.expiration_time = 600 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.hashclient_retry_attempts = 2 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.memcache_dead_retry = 300 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.memcache_pool_maxsize = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.memcache_sasl_enabled = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.password = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.proxies = [] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.redis_db = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.redis_server = localhost:6379 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.retry_attempts = 2 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.retry_delay = 0.0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.socket_keepalive_count = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.socket_keepalive_idle = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.socket_keepalive_interval = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.socket_timeout = 1.0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.tls_allowed_ciphers = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.tls_cafile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87064) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.tls_certfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.quobyte [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.tls_enabled = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.tls_keyfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cache.username = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] coordination.backend_url = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.asyncio_connection = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.quobyte [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.asyncio_slave_connection = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.backend = sqlalchemy {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.connection = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.connection_debug = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.connection_parameters = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.connection_recycle_time = 3600 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Running cmd (subprocess): mount.quobyte {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.connection_trace = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.db_inc_retry_interval = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.db_max_retries = 20 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.db_max_retry_interval = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.db_retry_interval = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.max_overflow = 50 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.max_pool_size = 5 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.max_retries = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.mysql_wsrep_sync_wait = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.pool_timeout = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.retry_interval = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.slave_connection = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.sqlite_synchronous = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.synchronous_reader = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] database.use_db_reconnect = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_tracing.insecure = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler.connection_string = messaging:// {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler.enabled = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler.es_doc_type = notification {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler.es_scroll_size = 10000 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler.es_scroll_time = 2m {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler.filter_error_trace = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler.hmac_keys = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler.sentinel_service_name = mymaster {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler.socket_timeout = 0.1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler.trace_requests = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler.trace_sqlalchemy = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler_jaeger.process_tags = {} {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler_jaeger.service_name_prefix = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] profiler_otlp.service_name_prefix = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_policy.enforce_new_defaults = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_policy.policy_default_rule = default {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_policy.policy_file = policy.yaml {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] privsep_osbrick.group = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] privsep_osbrick.helper_command = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] privsep_osbrick.user = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cinder_sys_admin.group = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cinder_sys_admin.helper_command = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] cinder_sys_admin.user = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] service_user.auth_section = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] service_user.auth_type = password {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] service_user.cafile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] service_user.certfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] service_user.collect_timing = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] service_user.insecure = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] service_user.keyfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] service_user.send_service_user_token = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] service_user.split_loggers = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] service_user.timeout = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance.auth_section = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance.auth_type = password {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance.certfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance.collect_timing = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance.insecure = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance.keyfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance.region_name = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance.split_loggers = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] glance.timeout = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.backend_availability_zone = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.chap_password = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.chap_username = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.disk_geometry = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.driver_client_cert = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.driver_client_cert_key = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.driver_data_namespace = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.driver_use_ssl = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.extra_capabilities = {} {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.filter_function = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.goodness_function = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.iscsi_target_flags = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.iscsi_write_cache = on {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.iser_helper = tgtadm {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.iser_ip_address = 192.168.122.211 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.iser_port = 3260 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nas_host = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nas_login = admin {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nas_mount_options = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nas_password = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nas_private_key = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nas_share_path = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.num_shell_tries = 3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.quobyte_volume_url = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.replication_device = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.report_discard_supported = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.reserved_percentage = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.target_helper = tgtadm {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.target_ip_address = 192.168.122.211 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.target_port = 3260 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.target_protocol = iscsi {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.trace_flags = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.unique_fqdn_network = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.use_chap_auth = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.volume_backend_name = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.volume_clear = zero {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.volume_clear_ionice = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.volume_clear_size = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_reports.file_event_handler = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_reports.log_dir = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.backend_availability_zone = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.backend_host = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.chap_password = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.chap_username = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.chiscsi_conf = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.disk_geometry = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.driver_client_cert = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.driver_data_namespace = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.driver_use_ssl = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.extra_capabilities = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.filter_function = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.goodness_function = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.iser_helper = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.iser_ip_address = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.iser_port = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.iser_target_prefix = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nas_host = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nas_login = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nas_mount_options = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nas_password = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nas_private_key = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nas_share_path = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nas_ssh_port = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.num_shell_tries = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.nvmet_port_id = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.replication_device = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.report_discard_supported = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.reserved_percentage = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.scst_target_driver = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.storage_protocol = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.target_helper = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.target_ip_address = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.target_port = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.target_prefix = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.target_protocol = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.trace_flags = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.use_chap_auth = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.volume_clear = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.volume_clear_size = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] QuobyteHD.volumes_dir = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.ssl = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_notifications.driver = [] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_notifications.retry = -1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] key_manager.fixed_key = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.barbican_api_version = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.barbican_endpoint = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.barbican_endpoint_type = public {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.barbican_region_name = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.cafile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.certfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.collect_timing = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.insecure = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.keyfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.number_of_retries = 60 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.retry_delay = 1 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.send_service_user_token = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.split_loggers = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.timeout = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.verify_ssl = True {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican.verify_ssl_path = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican_service_user.auth_section = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican_service_user.auth_type = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican_service_user.cafile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican_service_user.certfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican_service_user.collect_timing = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican_service_user.insecure = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican_service_user.keyfile = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican_service_user.split_loggers = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] barbican_service_user.timeout = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.approle_role_id = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.approle_secret_id = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.auth_method = approle {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.auth_path = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.kv_mountpoint = secret {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.kv_path = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.kv_version = 2 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.namespace = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.root_token_id = **** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.ssl_ca_crt_file = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.timeout = 60.0 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.token_file = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.token_role = None {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.use_ssl = False {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:01:31 devstack cinder-volume[86756]: DEBUG oslo_service.backend._eventlet.service [None req-765d8f23-89d4-4688-acfd-bd1f0c80a34d None None] ******************************************************************************** {{(pid=86756) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:01:31 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.267s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:01:31 devstack cinder-volume[87064]: INFO cinder.volume.driver [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG cinder.volume.driver [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3822937011719, 'free_capacity_gb': 1774.3822937011719, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87064) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:01:31 devstack cinder-volume[87064]: DEBUG oslo_db.sqlalchemy.engines [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writer thread running {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG cinder.db.api [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Building query based on filter {{(pid=87064) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87064) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:01:32 devstack cinder-volume[87064]: INFO cinder.keymgr.migration [None req-e0f728b3-e041-4911-a195-1aa6d7eeb47a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:01:32 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:01:32 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:01:32 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.239s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:01:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Driver initialization completed successfully. Sep 01 01:01:32 devstack cinder-volume[87064]: INFO cinder.manager [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Initiating service 3 cleanup Sep 01 01:01:32 devstack cinder-volume[87064]: INFO cinder.manager [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Service 3 cleanup completed. Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG cinder.service [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Creating RPC server for service cinder-volume {{(pid=87064) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG cinder.service [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87064) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:01:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:01:32 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:01:32 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:01:32 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Sep 01 01:01:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.234s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:01:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b3c451ad-a649-4c6a-86bd-7d5654e114eb None None] Driver post RPC initialization completed successfully. Sep 01 01:01:41 devstack cinder-volume[86756]: DEBUG dbcounter [-] [86756] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86756) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:01:42 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=3 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:01:42 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:01:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:01:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 6 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:01:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:02:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:02:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:02:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:02:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:02:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:02:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:02:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:02:52 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:02:52 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:02:53 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Sep 01 01:02:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.390s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:02:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:02:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:02:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 6 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:02:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:02:59 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Flow 'volume_create_manager' (2a54dc98-82ef-4be9-a65d-8100730717a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa056b0b-8b85-4b0e-bc12-c4a3be700254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa056b0b-8b85-4b0e-bc12-c4a3be700254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1233402636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9af002141440beab2c569354ec023e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:03:00Z,use_quota=True,user_id='0ecd9e953a604a3fb8f0714c5d0e6dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68f54cb-1618-4d25-913f-01e8a4c149ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68f54cb-1618-4d25-913f-01e8a4c149ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759ffb1f-93ae-4681-9e9d-ac01bdfd454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759ffb1f-93ae-4681-9e9d-ac01bdfd454e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40', 'volume_name': 'volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7407ec4d-eb2c-4856-b8d1-d09952f82809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7407ec4d-eb2c-4856-b8d1-d09952f82809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed600194-1ee4-471c-a47c-057d350b7aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:00 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Volume 46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40', 'volume_size': 1} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1233402636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9af002141440beab2c569354ec023e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:03:00Z,use_quota=True,user_id='0ecd9e953a604a3fb8f0714c5d0e6dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Creating volume 46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:03:00 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:03:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:00 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40 1073741824 Sep 01 01:03:00 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:02 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40 1073741824" returned: 0 in 1.542s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:02 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40 Sep 01 01:03:02 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:02 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40" returned: 0 in 0.411s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:03:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed600194-1ee4-471c-a47c-057d350b7aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ed06eb-e19b-4cb7-9d9c-a652631df41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:02 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Volume volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40 (46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40): created successfully Sep 01 01:03:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ed06eb-e19b-4cb7-9d9c-a652631df41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Flow 'volume_create_manager' (2a54dc98-82ef-4be9-a65d-8100730717a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:03:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-471fd02f-c7b1-449f-a8ce-d64c6938c82d tempest-VolumesAdminNegativeTest-1748705283 None] Created volume successfully. Sep 01 01:03:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Acquiring lock "cinder-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:03:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Lock "cinder-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:03:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Acquiring lock "cinder-quobyte-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:03:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Lock "cinder-quobyte-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40" acquired by "delete_volume" :: waited 0.056s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:03:07 devstack cinder-volume[87064]: INFO oslo.privsep.daemon [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpm1el1gnw/privsep.sock'] Sep 01 01:03:07 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpm1el1gnw/privsep.sock Sep 01 01:03:07 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:09 devstack cinder-volume[87064]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 01:03:09 devstack cinder-volume[87064]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:03:09 devstack cinder-volume[87064]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 01:03:09 devstack cinder-volume[87064]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 01:03:09 devstack cinder-volume[87064]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:03:09 devstack cinder-volume[87064]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 01:03:09 devstack cinder-volume[87064]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:03:09 devstack cinder-volume[87064]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 01:03:09 devstack cinder-volume[87064]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 01:03:09 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:10 devstack cinder-volume[87064]: INFO oslo.privsep.daemon [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Spawned new privsep daemon via rootwrap Sep 01 01:03:10 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Accepted privsep connection to /tmp/tmpm1el1gnw/privsep.sock {{(pid=87064) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 01:03:10 devstack cinder-volume[87064]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 01:03:10 devstack cinder-volume[87064]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 01:03:10 devstack cinder-volume[87064]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 01:03:10 devstack cinder-volume[87064]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88338 Sep 01 01:03:10 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef35323-a8a3-4078-9402-876fe95666cb]: (2,) {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:03:10 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[429bdc04-709c-48bb-a3e7-d34d77facce4]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:03:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:10 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40 Sep 01 01:03:10 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:11 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40" returned: 0 in 0.989s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:11 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40 Sep 01 01:03:11 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:11 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40" returned: 0 in 0.829s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Lock "cinder-quobyte-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40" released by "delete_volume" :: held 4.928s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:03:12 devstack cinder-volume[87064]: WARNING cinder.quota [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:03:12 devstack cinder-volume[87064]: WARNING cinder.quota [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:03:12 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Created reservations ['1176743e-76ab-442a-bbaf-837a70c48982', '3e14b905-f920-420b-b5cc-14093cbd5338', '49546827-9498-49f7-bb9e-fb15315e9c04', '972b3ef9-24c0-4ec6-bb58-e3b521fb918d'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:03:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:03:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:03:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:12 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:03:12 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:13 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 1.082s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:13 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:03:13 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Deleted volume successfully. Sep 01 01:03:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-345c11e2-f88e-4042-a799-8a0fc9258c2e tempest-VolumesAdminNegativeTest-1748705283 None] Lock "cinder-46b9c9a5-2fb0-40a7-8ff9-b2803ed50a40-delete_volume" released by "delete_volume" :: held 6.915s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Flow 'volume_create_manager' (6ea59396-00b0-4dff-bb40-94b9d0dcaf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b214b1a-da98-494b-9e24-a1240ff2d3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b214b1a-da98-494b-9e24-a1240ff2d3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1371583883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53815478-daf6-48ea-866d-cc3f8b4d25cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff51117108641d09571cd8803c12d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:03:17Z,use_quota=True,user_id='1b9b61d1804048339015b5c2184c670d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dadd4cc-545e-4bda-b0f9-5b144a86fa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dadd4cc-545e-4bda-b0f9-5b144a86fa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa7b49f-a4f1-4fab-8b04-d6f9bd4fcef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa7b49f-a4f1-4fab-8b04-d6f9bd4fcef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53815478-daf6-48ea-866d-cc3f8b4d25cc', 'volume_name': 'volume-53815478-daf6-48ea-866d-cc3f8b4d25cc', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a3cc74-326d-4713-87c8-e061c9f80b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a3cc74-326d-4713-87c8-e061c9f80b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f8a44b-13eb-4dfd-907d-e7534e77f44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:17 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Volume 53815478-daf6-48ea-866d-cc3f8b4d25cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53815478-daf6-48ea-866d-cc3f8b4d25cc', 'volume_size': 1} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1371583883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53815478-daf6-48ea-866d-cc3f8b4d25cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff51117108641d09571cd8803c12d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:03:17Z,use_quota=True,user_id='1b9b61d1804048339015b5c2184c670d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Creating volume 53815478-daf6-48ea-866d-cc3f8b4d25cc {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:03:17 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:03:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:17 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc 1073741824 Sep 01 01:03:17 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:18 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc 1073741824" returned: 0 in 0.652s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:18 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc Sep 01 01:03:18 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:18 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc" returned: 0 in 0.296s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:03:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f8a44b-13eb-4dfd-907d-e7534e77f44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53815478-daf6-48ea-866d-cc3f8b4d25cc', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968e1560-5229-4789-b5f8-c385ca3bb6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:18 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Volume volume-53815478-daf6-48ea-866d-cc3f8b4d25cc (53815478-daf6-48ea-866d-cc3f8b4d25cc): created successfully Sep 01 01:03:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968e1560-5229-4789-b5f8-c385ca3bb6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Flow 'volume_create_manager' (6ea59396-00b0-4dff-bb40-94b9d0dcaf03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:03:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-1497db17-5e1d-4e62-8b35-f7dd937679a2 tempest-ServersNegativeTestJSON-1324612108 None] Created volume successfully. Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Flow 'volume_create_manager' (f35b7a6e-b2e0-4111-82bf-592f46126cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a1f888-e54a-4ec8-ade5-933f63fc5ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a1f888-e54a-4ec8-ade5-933f63fc5ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2090273350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a596981-6774-4506-a749-86534f3fbd82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff51117108641d09571cd8803c12d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:03:26Z,use_quota=True,user_id='1b9b61d1804048339015b5c2184c670d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47209b2-9969-44e2-a8ca-f4a9050dade7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47209b2-9969-44e2-a8ca-f4a9050dade7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691d22fe-2100-4004-b01c-c5381edf7452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691d22fe-2100-4004-b01c-c5381edf7452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a596981-6774-4506-a749-86534f3fbd82', 'volume_name': 'volume-1a596981-6774-4506-a749-86534f3fbd82', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e17ae68-c17a-4355-8321-9ead4e2e6d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e17ae68-c17a-4355-8321-9ead4e2e6d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0908357-c130-44e6-bd83-e8588ce4e988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:26 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Volume 1a596981-6774-4506-a749-86534f3fbd82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a596981-6774-4506-a749-86534f3fbd82', 'volume_size': 1} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2090273350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a596981-6774-4506-a749-86534f3fbd82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff51117108641d09571cd8803c12d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:03:26Z,use_quota=True,user_id='1b9b61d1804048339015b5c2184c670d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Creating volume 1a596981-6774-4506-a749-86534f3fbd82 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:03:26 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:03:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:26 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82 1073741824 Sep 01 01:03:26 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:27 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82 1073741824" returned: 0 in 0.695s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:27 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82 Sep 01 01:03:27 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:27 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82" returned: 0 in 0.383s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0908357-c130-44e6-bd83-e8588ce4e988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a596981-6774-4506-a749-86534f3fbd82', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a28fd11-efba-4315-b1f4-462d04607ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:27 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Volume volume-1a596981-6774-4506-a749-86534f3fbd82 (1a596981-6774-4506-a749-86534f3fbd82): created successfully Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a28fd11-efba-4315-b1f4-462d04607ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Flow 'volume_create_manager' (f35b7a6e-b2e0-4111-82bf-592f46126cd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:03:27 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-401fef69-97c1-48ec-97e0-44951a413a6f tempest-ServersNegativeTestJSON-1324612108 None] Created volume successfully. Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Flow 'volume_create_manager' (32840119-e301-4b45-b178-b6a12466ac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16631623-58e8-4fc4-a639-189c76c89811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16631623-58e8-4fc4-a639-189c76c89811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-882056664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1ca41c-9953-4edb-83c9-cf72adadc587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00c8b2c52441d6a1b616ea21d9f082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:03:28Z,use_quota=True,user_id='2f2b469b78754046b20e8fc70e0cc36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1273c3-6d42-4281-bad5-3f70f611978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1273c3-6d42-4281-bad5-3f70f611978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1230a934-41ce-446f-ad70-4d115642e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1230a934-41ce-446f-ad70-4d115642e263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1ca41c-9953-4edb-83c9-cf72adadc587', 'volume_name': 'volume-9c1ca41c-9953-4edb-83c9-cf72adadc587', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde08252-75b7-477b-b472-87505ff5f984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde08252-75b7-477b-b472-87505ff5f984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912a565a-9a3b-4d73-b857-094b1a1d2aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:27 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Volume 9c1ca41c-9953-4edb-83c9-cf72adadc587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1ca41c-9953-4edb-83c9-cf72adadc587', 'volume_size': 1} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-882056664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1ca41c-9953-4edb-83c9-cf72adadc587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00c8b2c52441d6a1b616ea21d9f082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:03:28Z,use_quota=True,user_id='2f2b469b78754046b20e8fc70e0cc36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Creating volume 9c1ca41c-9953-4edb-83c9-cf72adadc587 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:03:27 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:03:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:27 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587 1073741824 Sep 01 01:03:27 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:28 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587 1073741824" returned: 0 in 0.782s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:28 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587 Sep 01 01:03:28 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:29 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587" returned: 0 in 0.310s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912a565a-9a3b-4d73-b857-094b1a1d2aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1ca41c-9953-4edb-83c9-cf72adadc587', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fa46a6-d87c-4146-845f-cdd83bf66e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:29 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Volume volume-9c1ca41c-9953-4edb-83c9-cf72adadc587 (9c1ca41c-9953-4edb-83c9-cf72adadc587): created successfully Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fa46a6-d87c-4146-845f-cdd83bf66e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Flow 'volume_create_manager' (32840119-e301-4b45-b178-b6a12466ac63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:03:29 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b49d3f28-3c53-44d9-b6f6-c8190c74f9cb tempest-AttachVolumeShelveTestJSON-847308226 None] Created volume successfully. Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Acquiring lock "cinder-1a596981-6774-4506-a749-86534f3fbd82-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "cinder-1a596981-6774-4506-a749-86534f3fbd82-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Acquiring lock "cinder-quobyte-1a596981-6774-4506-a749-86534f3fbd82" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "cinder-quobyte-1a596981-6774-4506-a749-86534f3fbd82" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2ea15e-f8d8-43b8-8a0c-75a0dbac73f3]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:03:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:30 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82 Sep 01 01:03:30 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:30 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82" returned: 0 in 0.587s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:30 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82 Sep 01 01:03:30 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:30 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a596981-6774-4506-a749-86534f3fbd82" returned: 0 in 0.416s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:30 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "cinder-quobyte-1a596981-6774-4506-a749-86534f3fbd82" released by "delete_volume" :: held 1.072s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:03:30 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Created reservations ['874d5b80-8ad2-4801-8038-970c00f78fc9', '1888b16b-ac61-4fe0-b0ff-9dc723ec3b97', 'e73e3181-756c-42bd-93a4-4698dd17d54c', 'e607d9d9-b0b2-4884-b621-301618a652bd'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:03:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:03:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:03:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:31 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:03:31 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:31 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.305s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:31 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:03:31 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Deleted volume successfully. Sep 01 01:03:31 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9d9925dc-aa47-4f44-bb24-0f9e9846dbc1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "cinder-1a596981-6774-4506-a749-86534f3fbd82-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:03:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Acquiring lock "cinder-53815478-daf6-48ea-866d-cc3f8b4d25cc-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:03:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "cinder-53815478-daf6-48ea-866d-cc3f8b4d25cc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:03:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Acquiring lock "cinder-quobyte-53815478-daf6-48ea-866d-cc3f8b4d25cc" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:03:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "cinder-quobyte-53815478-daf6-48ea-866d-cc3f8b4d25cc" acquired by "delete_volume" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:03:32 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4535d06a-891f-494e-ac7a-9d454ec8e3a8]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:03:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:32 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc Sep 01 01:03:32 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:32 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc" returned: 0 in 0.569s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:32 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc Sep 01 01:03:32 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:33 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53815478-daf6-48ea-866d-cc3f8b4d25cc" returned: 0 in 0.441s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "cinder-quobyte-53815478-daf6-48ea-866d-cc3f8b4d25cc" released by "delete_volume" :: held 1.087s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Created reservations ['c5d42759-0590-4387-bdae-1476b568677e', '6c6eb3c0-6d9b-4dc9-9c17-e0a7b673b502', 'c7dcb765-3629-447c-96e0-86ba69dbd6b5', 'adc8e5cd-c659-4a71-b7fb-0f783859abfc'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:33 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:03:33 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:33 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.366s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:03:33 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Deleted volume successfully. Sep 01 01:03:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e676c7-7867-46bc-a659-bddfe8b778f1 tempest-ServersNegativeTestJSON-1324612108 None] Lock "cinder-53815478-daf6-48ea-866d-cc3f8b4d25cc-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:03:43 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=25,cinder:UPDATE=35,cinder:DELETE=5,cinder:INSERT=7 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:03:43 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=38,cinder:SELECT=22,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Flow 'volume_create_manager' (55569a5a-9e62-40a4-b238-7c7b08327dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4770b3cf-3609-4a75-bd6e-74651baa8edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4770b3cf-3609-4a75-bd6e-74651baa8edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1591237611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a47c98-1906-449f-bd05-b7840866e40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a28100ea7e54cd8933f6590f519dd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:03:49Z,use_quota=True,user_id='0de00a1c729b4b939674ad57eb482acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df238df-e4ae-4c8c-b68c-a2cd14aa2087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df238df-e4ae-4c8c-b68c-a2cd14aa2087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e0f7ee-8e1a-425c-beed-97326e12bf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e0f7ee-8e1a-425c-beed-97326e12bf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a47c98-1906-449f-bd05-b7840866e40d', 'volume_name': 'volume-a9a47c98-1906-449f-bd05-b7840866e40d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d07a7e-75e6-4a86-a308-8052612abf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d07a7e-75e6-4a86-a308-8052612abf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b28be08-1bba-4540-bded-cbed6958db41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:49 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Volume a9a47c98-1906-449f-bd05-b7840866e40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a47c98-1906-449f-bd05-b7840866e40d', 'volume_size': 1} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1591237611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a47c98-1906-449f-bd05-b7840866e40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a28100ea7e54cd8933f6590f519dd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:03:49Z,use_quota=True,user_id='0de00a1c729b4b939674ad57eb482acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Creating volume a9a47c98-1906-449f-bd05-b7840866e40d {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:03:49 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:03:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:49 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d 1073741824 Sep 01 01:03:49 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:50 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d 1073741824" returned: 0 in 0.941s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:50 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d Sep 01 01:03:50 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:50 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d" returned: 0 in 0.384s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:03:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b28be08-1bba-4540-bded-cbed6958db41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a47c98-1906-449f-bd05-b7840866e40d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd2ce55-8d2b-48ef-862a-d6727729b70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:03:50 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Volume volume-a9a47c98-1906-449f-bd05-b7840866e40d (a9a47c98-1906-449f-bd05-b7840866e40d): created successfully Sep 01 01:03:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd2ce55-8d2b-48ef-862a-d6727729b70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:03:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Flow 'volume_create_manager' (55569a5a-9e62-40a4-b238-7c7b08327dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:03:50 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-edab9780-d3f2-450f-b2b6-4bbc98e1695f tempest-DeleteServersTestJSON-1394531797 None] Created volume successfully. Sep 01 01:03:51 devstack cinder-volume[87064]: WARNING py.warnings [req-248b8650-0948-42c3-b3c2-37d184316bd0 req-964bb0ac-43a9-46fe-afb2-852eaad13e40 tempest-AttachVolumeShelveTestJSON-847308226 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 01 01:03:51 devstack cinder-volume[87064]: .first() Sep 01 01:03:51 devstack cinder-volume[87064]: Sep 01 01:03:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-248b8650-0948-42c3-b3c2-37d184316bd0 req-964bb0ac-43a9-46fe-afb2-852eaad13e40 tempest-AttachVolumeShelveTestJSON-847308226 None] No connector for attachment c0a10ae0-eec6-47ce-b072-5e32d4602730; skipping storage backend terminate_connection call. {{(pid=87064) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 01:03:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-248b8650-0948-42c3-b3c2-37d184316bd0 req-964bb0ac-43a9-46fe-afb2-852eaad13e40 tempest-AttachVolumeShelveTestJSON-847308226 None] Deleting attachment c0a10ae0-eec6-47ce-b072-5e32d4602730. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:03:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:03:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:03:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:03:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:03:52 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:03:52 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:03:53 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Sep 01 01:03:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.365s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:03:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:03:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:03:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 8 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:03:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:03:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-c1310f9f-3c15-4028-873a-73e54afba9ec req-04edc785-b6ca-410b-aa9f-09ed97d09ce6 tempest-DeleteServersTestJSON-1394531797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:03:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-c1310f9f-3c15-4028-873a-73e54afba9ec req-04edc785-b6ca-410b-aa9f-09ed97d09ce6 tempest-DeleteServersTestJSON-1394531797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:03:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-c1310f9f-3c15-4028-873a-73e54afba9ec req-04edc785-b6ca-410b-aa9f-09ed97d09ce6 tempest-DeleteServersTestJSON-1394531797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:03:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-c1310f9f-3c15-4028-873a-73e54afba9ec req-04edc785-b6ca-410b-aa9f-09ed97d09ce6 tempest-DeleteServersTestJSON-1394531797 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-a9a47c98-1906-449f-bd05-b7840866e40d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff3a5f8f-3b9b-48ae-bbdd-b9c534ebd4f1', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:03:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-c1310f9f-3c15-4028-873a-73e54afba9ec req-04edc785-b6ca-410b-aa9f-09ed97d09ce6 tempest-DeleteServersTestJSON-1394531797 None] attachment_update completed successfully. Sep 01 01:04:05 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:04:05 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9,cinder:INSERT=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:04:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-68728974-7c19-4b3a-8b94-94b64459f09a req-070df752-789e-4c7a-9c78-ed17295dc3de tempest-DeleteServersTestJSON-1394531797 None] Terminate volume connection completed successfully. Sep 01 01:04:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-68728974-7c19-4b3a-8b94-94b64459f09a req-070df752-789e-4c7a-9c78-ed17295dc3de tempest-DeleteServersTestJSON-1394531797 None] Deleting attachment ff3a5f8f-3b9b-48ae-bbdd-b9c534ebd4f1. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:04:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Acquiring lock "cinder-a9a47c98-1906-449f-bd05-b7840866e40d-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:04:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Lock "cinder-a9a47c98-1906-449f-bd05-b7840866e40d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:04:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Acquiring lock "cinder-quobyte-a9a47c98-1906-449f-bd05-b7840866e40d" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:04:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Lock "cinder-quobyte-a9a47c98-1906-449f-bd05-b7840866e40d" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:04:10 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c218f1ce-6280-4c52-a92c-2a7e65f5891e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:04:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:04:10 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d Sep 01 01:04:10 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:04:10 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Sep 01 01:04:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d" returned: 0 in 0.438s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:04:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:04:10 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d Sep 01 01:04:10 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:04:10 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Sep 01 01:04:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a9a47c98-1906-449f-bd05-b7840866e40d" returned: 0 in 0.280s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:04:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Lock "cinder-quobyte-a9a47c98-1906-449f-bd05-b7840866e40d" released by "delete_volume" :: held 0.780s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:04:10 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Created reservations ['d6d699c8-7a7b-4fc5-834b-508f448ab752', '58d0823f-b1e8-4432-9b65-5941bcd17bd1', '89c49e62-b2c4-4135-99dd-10ed0a0a143d', '6ca89ce2-8f66-43cc-86d7-6400a67fc8c5'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:04:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:04:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:04:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:04:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:04:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:04:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:04:11 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:04:11 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:04:11 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Sep 01 01:04:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.411s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:04:11 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:04:11 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Deleted volume successfully. Sep 01 01:04:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-149025c9-bf1b-45f5-9747-8e2e77e18834 tempest-DeleteServersTestJSON-1394531797 None] Lock "cinder-a9a47c98-1906-449f-bd05-b7840866e40d-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:04:21 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:04:21 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Flow 'volume_create_manager' (33bc7c9b-af2f-42b4-ac13-2e3d0633b5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae374dca-a528-48ab-bf62-142af26f7b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae374dca-a528-48ab-bf62-142af26f7b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-146055667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ffa5b90-f4dd-4192-8ac4-421dd1f15260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b256189462467582d7cc9720e630c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:04:28Z,use_quota=True,user_id='e46f77c52b8e4568acb5e33c78b1e70c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c81914-86d1-4532-98c7-51c3c8fea6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c81914-86d1-4532-98c7-51c3c8fea6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7490bfa-f6c2-4a7e-88d4-ecc011566bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7490bfa-f6c2-4a7e-88d4-ecc011566bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ffa5b90-f4dd-4192-8ac4-421dd1f15260', 'volume_name': 'volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2e4828-4f26-4d26-a19e-e5305a5226d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2e4828-4f26-4d26-a19e-e5305a5226d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f718acfe-b4da-4570-8c1b-23d16ff093d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:04:28 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Volume 5ffa5b90-f4dd-4192-8ac4-421dd1f15260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260', 'volume_size': 1} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-146055667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ffa5b90-f4dd-4192-8ac4-421dd1f15260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b256189462467582d7cc9720e630c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:04:28Z,use_quota=True,user_id='e46f77c52b8e4568acb5e33c78b1e70c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Creating volume 5ffa5b90-f4dd-4192-8ac4-421dd1f15260 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:04:28 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:04:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:04:28 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260 1073741824 Sep 01 01:04:28 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:04:29 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Sep 01 01:04:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260 1073741824" returned: 0 in 0.957s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:04:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:04:29 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260 Sep 01 01:04:29 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:04:29 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Sep 01 01:04:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260" returned: 0 in 0.333s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:04:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:04:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:04:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f718acfe-b4da-4570-8c1b-23d16ff093d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:04:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5839e175-ff0b-46fe-bc30-206d71653e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:04:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Volume volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260 (5ffa5b90-f4dd-4192-8ac4-421dd1f15260): created successfully Sep 01 01:04:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5839e175-ff0b-46fe-bc30-206d71653e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:04:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Flow 'volume_create_manager' (33bc7c9b-af2f-42b4-ac13-2e3d0633b5b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:04:30 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-07e2680f-b5b7-49ae-9f21-a7db1f02cf8a tempest-TaggedAttachmentsTest-352045838 None] Created volume successfully. Sep 01 01:04:40 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:04:40 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:04:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:04:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:04:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:04:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:04:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:04:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:04:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:04:52 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:04:52 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:04:53 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Sep 01 01:04:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.531s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:04:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:04:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Acquiring lock "cinder-9c1ca41c-9953-4edb-83c9-cf72adadc587-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:04:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Lock "cinder-9c1ca41c-9953-4edb-83c9-cf72adadc587-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:04:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Acquiring lock "cinder-quobyte-9c1ca41c-9953-4edb-83c9-cf72adadc587" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:04:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Lock "cinder-quobyte-9c1ca41c-9953-4edb-83c9-cf72adadc587" acquired by "delete_volume" :: waited 0.084s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:04:59 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82c6400-1b94-4558-86df-f5564defccd3]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:04:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:04:59 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587 Sep 01 01:04:59 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:05:00 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Sep 01 01:05:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587" returned: 0 in 1.133s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:05:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:05:00 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587 Sep 01 01:05:00 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:05:01 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Sep 01 01:05:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9c1ca41c-9953-4edb-83c9-cf72adadc587" returned: 0 in 0.665s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:05:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Lock "cinder-quobyte-9c1ca41c-9953-4edb-83c9-cf72adadc587" released by "delete_volume" :: held 2.017s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:05:01 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Created reservations ['1e6aefa6-60dc-42e2-a132-9ac59e4fd4d4', 'd8201244-886d-47de-8926-889a64150525', '4d36133d-9b13-4f80-ba13-8cf37b1c0181', '3b03abaa-d281-4f70-8383-762dc157343a'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:05:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:05:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:05:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:05:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:05:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:05:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:05:02 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:05:02 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:05:02 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Sep 01 01:05:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.647s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:05:02 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:05:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Deleted volume successfully. Sep 01 01:05:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-91c2e842-7547-433c-9ea7-3e8a397e7e9a tempest-AttachVolumeShelveTestJSON-847308226 None] Lock "cinder-9c1ca41c-9953-4edb-83c9-cf72adadc587-delete_volume" released by "delete_volume" :: held 3.556s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Flow 'volume_create_manager' (998a2e43-f6a5-4b52-84ca-0b370c35729c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a9d2a80-674d-4e44-89f5-347059fa46cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a9d2a80-674d-4e44-89f5-347059fa46cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1328809046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6a0adc-8202-4148-a79d-fd13b9e2e0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9191b55354de4ee1a46707fa208c9bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:05:05Z,use_quota=True,user_id='3da97dd9e4694f71964b6df902e3931e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f074e75-ee6f-431c-b515-f040e73d3595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f074e75-ee6f-431c-b515-f040e73d3595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf099b9-d48c-4c99-9eb7-2d3abebb6a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf099b9-d48c-4c99-9eb7-2d3abebb6a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6a0adc-8202-4148-a79d-fd13b9e2e0b8', 'volume_name': 'volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f829d5b-6d83-4054-a8be-8deeead94ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f829d5b-6d83-4054-a8be-8deeead94ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f8b94c-c078-4333-b514-9fa43a56ea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:05 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Volume 3a6a0adc-8202-4148-a79d-fd13b9e2e0b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8', 'volume_size': 1} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1328809046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6a0adc-8202-4148-a79d-fd13b9e2e0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9191b55354de4ee1a46707fa208c9bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:05:05Z,use_quota=True,user_id='3da97dd9e4694f71964b6df902e3931e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Creating volume 3a6a0adc-8202-4148-a79d-fd13b9e2e0b8 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:05:05 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:05:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:05:05 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8 1073741824 Sep 01 01:05:05 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:05:06 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Sep 01 01:05:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8 1073741824" returned: 0 in 1.206s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:05:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:05:06 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8 Sep 01 01:05:06 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:05:07 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Sep 01 01:05:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8" returned: 0 in 0.625s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:05:07 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:05:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:05:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f8b94c-c078-4333-b514-9fa43a56ea4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450f1c51-ef86-409d-b565-e33a21f73179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:07 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Volume volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8 (3a6a0adc-8202-4148-a79d-fd13b9e2e0b8): created successfully Sep 01 01:05:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450f1c51-ef86-409d-b565-e33a21f73179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Flow 'volume_create_manager' (998a2e43-f6a5-4b52-84ca-0b370c35729c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:05:07 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-76bedb88-0356-4fd7-99e6-d0fb8606db6d tempest-AttachVolumeNegativeTest-355458312 None] Created volume successfully. Sep 01 01:05:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-578868b3-1195-4215-a998-8e68e70dc5bc req-bb7d9119-a63a-4da5-a31e-97434fa6dc53 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:05:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-578868b3-1195-4215-a998-8e68e70dc5bc req-bb7d9119-a63a-4da5-a31e-97434fa6dc53 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:05:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-578868b3-1195-4215-a998-8e68e70dc5bc req-bb7d9119-a63a-4da5-a31e-97434fa6dc53 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.067s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:05:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-578868b3-1195-4215-a998-8e68e70dc5bc req-bb7d9119-a63a-4da5-a31e-97434fa6dc53 tempest-AttachVolumeNegativeTest-355458312 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be2985af-0612-4708-a844-524c4710fe68', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:05:10 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-578868b3-1195-4215-a998-8e68e70dc5bc req-bb7d9119-a63a-4da5-a31e-97434fa6dc53 tempest-AttachVolumeNegativeTest-355458312 None] attachment_update completed successfully. Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Flow 'volume_create_manager' (a29a1ee4-ecf1-4f5e-8cbc-6487ffa0bc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fb1339-4ada-4197-bdb6-3705115a183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fb1339-4ada-4197-bdb6-3705115a183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-250754255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc40161-2162-49aa-bcee-9206dd00f682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ce4f58b3147148e3e991d68574d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:05:17Z,use_quota=True,user_id='ed17f6bcdaf4453f993441aa1333aa9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6760591f-c6bc-448c-8ae1-f4afb2a06d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6760591f-c6bc-448c-8ae1-f4afb2a06d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721247f9-8a5b-4d36-b323-4bc44827dc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721247f9-8a5b-4d36-b323-4bc44827dc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acc40161-2162-49aa-bcee-9206dd00f682', 'volume_name': 'volume-acc40161-2162-49aa-bcee-9206dd00f682', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae11055e-a6e6-4428-a6b7-308d82160115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae11055e-a6e6-4428-a6b7-308d82160115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e2c4e2-2f9e-424f-9454-f035e4d40af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:17 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Volume acc40161-2162-49aa-bcee-9206dd00f682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acc40161-2162-49aa-bcee-9206dd00f682', 'volume_size': 1} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-250754255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc40161-2162-49aa-bcee-9206dd00f682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ce4f58b3147148e3e991d68574d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:05:17Z,use_quota=True,user_id='ed17f6bcdaf4453f993441aa1333aa9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Creating volume acc40161-2162-49aa-bcee-9206dd00f682 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:05:17 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:05:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:05:17 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682 1073741824 Sep 01 01:05:17 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:05:18 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Sep 01 01:05:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682 1073741824" returned: 0 in 1.030s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:05:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:05:18 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682 Sep 01 01:05:18 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:05:19 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Sep 01 01:05:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682" returned: 0 in 0.701s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:05:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:05:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:05:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e2c4e2-2f9e-424f-9454-f035e4d40af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acc40161-2162-49aa-bcee-9206dd00f682', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc040f5-4e7c-4d53-8dc7-2e8472108efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:05:19 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Volume volume-acc40161-2162-49aa-bcee-9206dd00f682 (acc40161-2162-49aa-bcee-9206dd00f682): created successfully Sep 01 01:05:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc040f5-4e7c-4d53-8dc7-2e8472108efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:05:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Flow 'volume_create_manager' (a29a1ee4-ecf1-4f5e-8cbc-6487ffa0bc3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:05:19 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-66ebfe99-f35a-45af-aa10-48ab1256cf6f tempest-ServerRescueNegativeTestJSON-441343185 None] Created volume successfully. Sep 01 01:05:29 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=18,cinder:INSERT=3,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:05:29 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=16,cinder:SELECT=13,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:05:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Acquiring lock "cinder-acc40161-2162-49aa-bcee-9206dd00f682-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:05:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Lock "cinder-acc40161-2162-49aa-bcee-9206dd00f682-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:05:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Acquiring lock "cinder-quobyte-acc40161-2162-49aa-bcee-9206dd00f682" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:05:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Lock "cinder-quobyte-acc40161-2162-49aa-bcee-9206dd00f682" acquired by "delete_volume" :: waited 0.073s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:05:42 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15acba5-4cd3-43e5-9b6f-ff75db6cda09]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:05:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:05:42 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682 Sep 01 01:05:42 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:05:43 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Sep 01 01:05:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682" returned: 0 in 1.148s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:05:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:05:43 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682 Sep 01 01:05:43 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:05:44 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Sep 01 01:05:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-acc40161-2162-49aa-bcee-9206dd00f682" returned: 0 in 0.570s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:05:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Lock "cinder-quobyte-acc40161-2162-49aa-bcee-9206dd00f682" released by "delete_volume" :: held 1.900s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:05:44 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Created reservations ['49ec189e-1991-4cfa-9d32-9ff566560a00', '72e549b4-a02c-4468-93c8-7db8680dec91', '8a9f1b77-ed98-4cbf-af84-5c8998e4d235', 'fb1e215b-af59-4908-9fb3-b8b9f83a8387'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:05:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:05:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:05:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:05:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:05:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:05:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:05:44 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:05:44 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:05:45 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Sep 01 01:05:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.721s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:05:45 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:05:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Deleted volume successfully. Sep 01 01:05:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c55ce8f-6ae7-4e81-a4d7-c6a79af067da tempest-ServerRescueNegativeTestJSON-441343185 None] Lock "cinder-acc40161-2162-49aa-bcee-9206dd00f682-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:05:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-9266c148-3b77-48cc-b31b-b1185d99438f req-6cd51f72-83fd-463a-99d3-30ee1d4c2e92 tempest-TaggedAttachmentsTest-352045838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:05:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-9266c148-3b77-48cc-b31b-b1185d99438f req-6cd51f72-83fd-463a-99d3-30ee1d4c2e92 tempest-TaggedAttachmentsTest-352045838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:05:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-9266c148-3b77-48cc-b31b-b1185d99438f req-6cd51f72-83fd-463a-99d3-30ee1d4c2e92 tempest-TaggedAttachmentsTest-352045838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:05:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-9266c148-3b77-48cc-b31b-b1185d99438f req-6cd51f72-83fd-463a-99d3-30ee1d4c2e92 tempest-TaggedAttachmentsTest-352045838 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55ea75c3-2e31-4684-93f1-30772c7caa4a', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:05:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-9266c148-3b77-48cc-b31b-b1185d99438f req-6cd51f72-83fd-463a-99d3-30ee1d4c2e92 tempest-TaggedAttachmentsTest-352045838 None] attachment_update completed successfully. Sep 01 01:05:49 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-ce5060bb-5be0-4d6b-b083-b2a05522efbd req-c568af33-923f-4ea4-ace5-85674404a58a tempest-TaggedAttachmentsTest-352045838 None] Terminate volume connection completed successfully. Sep 01 01:05:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ce5060bb-5be0-4d6b-b083-b2a05522efbd req-c568af33-923f-4ea4-ace5-85674404a58a tempest-TaggedAttachmentsTest-352045838 None] Deleting attachment 55ea75c3-2e31-4684-93f1-30772c7caa4a. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:05:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:05:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:05:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:05:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:05:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:05:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:05:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:05:52 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:05:52 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:05:53 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Sep 01 01:05:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.585s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:05:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:05:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:05:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 8 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:05:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:05:55 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=12,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:05:59 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=8,cinder:SELECT=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:06:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-71006863-e5d9-46ed-8c93-97597d9721a9 req-9164bd18-eb6c-4e52-825f-d8c4c85048c3 tempest-AttachVolumeNegativeTest-355458312 None] Terminate volume connection completed successfully. Sep 01 01:06:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-71006863-e5d9-46ed-8c93-97597d9721a9 req-9164bd18-eb6c-4e52-825f-d8c4c85048c3 tempest-AttachVolumeNegativeTest-355458312 None] Deleting attachment be2985af-0612-4708-a844-524c4710fe68. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Flow 'volume_create_manager' (f22deaab-0ccd-40b1-b711-aa27d44d3571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5569f744-6ea5-4e9b-b620-b9eae8f8f746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5569f744-6ea5-4e9b-b620-b9eae8f8f746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1751690394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d80dce8-a0d8-48ca-8afa-61b968ee9234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5fbd963d5f412f82760c3928a9c4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:06:06Z,use_quota=True,user_id='959ad3069043444a916f3005268d5be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6898d1-b1d0-4758-a9dd-ab61517c57b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6898d1-b1d0-4758-a9dd-ab61517c57b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52aabfef-d9e9-4c08-98e1-2aa565d9110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52aabfef-d9e9-4c08-98e1-2aa565d9110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d80dce8-a0d8-48ca-8afa-61b968ee9234', 'volume_name': 'volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c0079a-9b7f-4c7f-ad34-06e89e8b147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c0079a-9b7f-4c7f-ad34-06e89e8b147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594b8ae6-0291-4b5b-9832-c8f62cbd254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:06 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Volume 0d80dce8-a0d8-48ca-8afa-61b968ee9234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234', 'volume_size': 1} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1751690394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d80dce8-a0d8-48ca-8afa-61b968ee9234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5fbd963d5f412f82760c3928a9c4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:06:06Z,use_quota=True,user_id='959ad3069043444a916f3005268d5be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Creating volume 0d80dce8-a0d8-48ca-8afa-61b968ee9234 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:06:06 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:06 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 1073741824 Sep 01 01:06:06 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Acquiring lock "cinder-5ffa5b90-f4dd-4192-8ac4-421dd1f15260-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Lock "cinder-5ffa5b90-f4dd-4192-8ac4-421dd1f15260-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Acquiring lock "cinder-quobyte-5ffa5b90-f4dd-4192-8ac4-421dd1f15260" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Lock "cinder-quobyte-5ffa5b90-f4dd-4192-8ac4-421dd1f15260" acquired by "delete_volume" :: waited 0.052s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebe59c6-08b7-499e-880a-8eeb313ca25e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:07 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260 Sep 01 01:06:07 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:07 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 1073741824" returned: 0 in 1.164s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:07 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 Sep 01 01:06:07 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:07 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234" returned: 0 in 0.433s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594b8ae6-0291-4b5b-9832-c8f62cbd254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafa2919-b96a-4222-a0e4-f7e4149561c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:07 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Volume volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 (0d80dce8-a0d8-48ca-8afa-61b968ee9234): created successfully Sep 01 01:06:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafa2919-b96a-4222-a0e4-f7e4149561c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:07 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Flow 'volume_create_manager' (f22deaab-0ccd-40b1-b711-aa27d44d3571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260" returned: 0 in 0.828s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:08 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-5fa3fab6-7076-4c3d-be44-3efd8765d11d req-10d382f8-2999-4a10-b244-5f9d7459c8a7 tempest-VolumesSnapshotsTestJSON-1060368962 None] Created volume successfully. Sep 01 01:06:08 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260 Sep 01 01:06:08 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:08 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5ffa5b90-f4dd-4192-8ac4-421dd1f15260" returned: 0 in 0.386s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Lock "cinder-quobyte-5ffa5b90-f4dd-4192-8ac4-421dd1f15260" released by "delete_volume" :: held 1.352s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Created reservations ['b245940f-8897-4396-916d-d0827cfe9cf4', '64fa8297-151d-4e81-8579-c524746d9c33', 'f34353e4-7249-43c8-90da-f80e5824a429', 'bd22399a-b266-4166-b368-896cc90a05b3'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:08 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:06:08 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:09 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.612s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:09 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:06:09 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Deleted volume successfully. Sep 01 01:06:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0844172-eb40-4bf9-8726-c6df7ace4b2b tempest-TaggedAttachmentsTest-352045838 None] Lock "cinder-5ffa5b90-f4dd-4192-8ac4-421dd1f15260-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] Creating offline snapshot ec49af19-edc0-4b30-a5f3-f8abfaa733e2 of volume 0d80dce8-a0d8-48ca-8afa-61b968ee9234 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:06:09 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[34484ab2-c9e3-48fb-b4d0-c27a00b59a34]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:09 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 Sep 01 01:06:09 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:10 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234" returned: 0 in 0.702s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:10 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 1G Sep 01 01:06:10 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:10 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 1G" returned: 0 in 0.738s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:11 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 Sep 01 01:06:11 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:11 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2" returned: 0 in 0.547s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:11 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 is being set with open permissions: ugo+rw Sep 01 01:06:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:11 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 Sep 01 01:06:11 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:11 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2" returned: 0 in 0.384s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:12 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.info Sep 01 01:06:12 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:12 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.info" returned: 0 in 0.426s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:12 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.info is being set with open permissions: ugo+rw Sep 01 01:06:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:12 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.info Sep 01 01:06:12 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:12 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.info" returned: 0 in 0.334s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.280s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:12 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-6c23f282-9093-4988-839f-919de9fe27f4 req-7f431a9f-b08d-4ddb-8507-7be47a1bea49 tempest-VolumesSnapshotsTestJSON-1060368962 None] Create snapshot completed successfully Sep 01 01:06:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Acquiring lock "cinder-ec49af19-edc0-4b30-a5f3-f8abfaa733e2-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "cinder-ec49af19-edc0-4b30-a5f3-f8abfaa733e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Acquiring lock "cinder-quobyte-0d80dce8-a0d8-48ca-8afa-61b968ee9234" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "cinder-quobyte-0d80dce8-a0d8-48ca-8afa-61b968ee9234" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Acquiring lock "cinder-quobyte-ec49af19-edc0-4b30-a5f3-f8abfaa733e2" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "cinder-quobyte-ec49af19-edc0-4b30-a5f3-f8abfaa733e2" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Deleting offline snapshot ec49af19-edc0-4b30-a5f3-f8abfaa733e2 of volume 0d80dce8-a0d8-48ca-8afa-61b968ee9234 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:06:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] snapshot_file for this snap is: volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:06:13 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1053bee9-6c2c-4c5a-9dc6-bd4229f6bbb6]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:13 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 Sep 01 01:06:13 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:14 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2" returned: 0 in 0.598s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:06:14 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d984e42-cbf9-47d8-9dcb-37345e2119cd]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:14 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 Sep 01 01:06:14 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:14 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234" returned: 0 in 0.551s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:14 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 Sep 01 01:06:14 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:15 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2" returned: 0 in 0.527s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:15 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2 Sep 01 01:06:15 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:15 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234.ec49af19-edc0-4b30-a5f3-f8abfaa733e2" returned: 0 in 0.292s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "cinder-quobyte-ec49af19-edc0-4b30-a5f3-f8abfaa733e2" released by "_delete_snapshot" :: held 2.202s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "cinder-quobyte-0d80dce8-a0d8-48ca-8afa-61b968ee9234" released by "delete_snapshot" :: held 2.262s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:15 devstack cinder-volume[87064]: WARNING cinder.quota [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:06:15 devstack cinder-volume[87064]: DEBUG cinder.quota [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Created reservations ['3b2d9aa2-58bc-4ce8-ace4-c0d9411f231f', '97be1870-193e-4c10-b0cb-6e5308a3464c', '6cffce04-274c-476d-bd6b-b555416f4b38', 'eaab0047-0a7c-4121-a0b7-aea5cb17cdf3'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:06:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Delete snapshot completed successfully. Sep 01 01:06:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-fd6999e8-dc81-483e-8dbb-263c700bccef req-23ee0c4e-1933-433e-83df-80bddabeeb10 tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "cinder-ec49af19-edc0-4b30-a5f3-f8abfaa733e2-delete_snapshot" released by "delete_snapshot" :: held 2.536s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Acquiring lock "cinder-0d80dce8-a0d8-48ca-8afa-61b968ee9234-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "cinder-0d80dce8-a0d8-48ca-8afa-61b968ee9234-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Acquiring lock "cinder-quobyte-0d80dce8-a0d8-48ca-8afa-61b968ee9234" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "cinder-quobyte-0d80dce8-a0d8-48ca-8afa-61b968ee9234" acquired by "delete_volume" :: waited 0.037s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:17 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdb786f-b5d8-481d-a682-b6898e4ab0d2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:17 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 Sep 01 01:06:17 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:17 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234" returned: 0 in 0.633s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:17 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234 Sep 01 01:06:17 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:18 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d80dce8-a0d8-48ca-8afa-61b968ee9234" returned: 0 in 0.410s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "cinder-quobyte-0d80dce8-a0d8-48ca-8afa-61b968ee9234" released by "delete_volume" :: held 1.196s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG cinder.quota [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Created reservations ['6fd28c72-fa58-4265-97db-1a612763316f', 'c45a73c3-d6c9-4854-b51a-081f28a9a50e', '2bb72e05-6e11-4a45-b180-7af10787e4c8', '7a51daee-8933-43ad-9c59-8818bf8d9c1f'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:18 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:06:18 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:18 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.303s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG cinder.manager [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:06:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Deleted volume successfully. Sep 01 01:06:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-10625767-49bd-4a7a-a6df-9696fcb57153 req-30f62bd6-2e95-42a0-b510-844572aec0ea tempest-VolumesSnapshotsTestJSON-1060368962 None] Lock "cinder-0d80dce8-a0d8-48ca-8afa-61b968ee9234-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:27 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6920c000-932c-461f-9c27-99fb0e477e7c tempest-GroupSnapshotsTest-649271858 None] Group tempest-GroupSnapshotsTest-Group-197078234: creating Sep 01 01:06:28 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6920c000-932c-461f-9c27-99fb0e477e7c tempest-GroupSnapshotsTest-649271858 None] Group tempest-GroupSnapshotsTest-Group-197078234: created successfully Sep 01 01:06:28 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6920c000-932c-461f-9c27-99fb0e477e7c tempest-GroupSnapshotsTest-649271858 None] Create group completed successfully. Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Flow 'volume_create_manager' (5c15e420-c00e-4c76-9e38-8948a2efb615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526ba2be-3967-4bda-8049-5a4ffd09615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526ba2be-3967-4bda-8049-5a4ffd09615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-496804511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b8e0bc4-fbe9-4f66-8aa1-a1ef4f58e44e,host='devstack@QuobyteHD#QuobyteHD',id=e55c5233-457e-4e0a-98a7-df04a6bc1b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a072f674603458fa8b78eaadc2a8739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:06:30Z,use_quota=True,user_id='484dcaad73bf4c328b62c97a594ce9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f716adb6-650c-4e2d-bb34-620f9fc9fe42),volume_type_id=f716adb6-650c-4e2d-bb34-620f9fc9fe42)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028a4645-169d-4210-8049-3c6d6d680b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028a4645-169d-4210-8049-3c6d6d680b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2467210e-685a-4aef-b8d6-4b434b1eafe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2467210e-685a-4aef-b8d6-4b434b1eafe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e55c5233-457e-4e0a-98a7-df04a6bc1b91', 'volume_name': 'volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9042fa42-eb64-454f-8e8f-a1e6cbe56c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9042fa42-eb64-454f-8e8f-a1e6cbe56c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e1d2d3-6b7a-4b35-b38e-826523b9b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:29 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Volume e55c5233-457e-4e0a-98a7-df04a6bc1b91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91', 'volume_size': 1} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1b8e0bc4-fbe9-4f66-8aa1-a1ef4f58e44e,created_at=2026-08-31T23:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-496804511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b8e0bc4-fbe9-4f66-8aa1-a1ef4f58e44e,host='devstack@QuobyteHD#QuobyteHD',id=e55c5233-457e-4e0a-98a7-df04a6bc1b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a072f674603458fa8b78eaadc2a8739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:06:30Z,use_quota=True,user_id='484dcaad73bf4c328b62c97a594ce9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f716adb6-650c-4e2d-bb34-620f9fc9fe42),volume_type_id=f716adb6-650c-4e2d-bb34-620f9fc9fe42)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Creating volume e55c5233-457e-4e0a-98a7-df04a6bc1b91 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:06:29 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:06:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:29 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 1073741824 Sep 01 01:06:29 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:30 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 1073741824" returned: 0 in 0.570s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:30 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 Sep 01 01:06:30 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:30 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91" returned: 0 in 0.510s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:06:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e1d2d3-6b7a-4b35-b38e-826523b9b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64f8d38-e114-4507-8c02-bc4f68f23e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:31 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Volume volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 (e55c5233-457e-4e0a-98a7-df04a6bc1b91): created successfully Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64f8d38-e114-4507-8c02-bc4f68f23e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Flow 'volume_create_manager' (5c15e420-c00e-4c76-9e38-8948a2efb615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:06:31 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-01076d1f-e39b-4f68-aba8-ba53aec851b2 tempest-GroupSnapshotsTest-649271858 None] Created volume successfully. Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Flow 'volume_create_manager' (2d182da0-0a37-4831-99a3-706d4459989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd325cf3-2fe7-4a5d-b9bd-a9add9f43d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd325cf3-2fe7-4a5d-b9bd-a9add9f43d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-701124156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b48f387-c08a-488d-9eb1-503912794605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e16662350754443b690e77877437ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:06:31Z,use_quota=True,user_id='7abc31e384944f6da86059422e85462d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a0db43-d8c8-4587-b5f2-7e221f422785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a0db43-d8c8-4587-b5f2-7e221f422785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fbfd6c-f1bf-48b6-8b9b-4a989d46add9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fbfd6c-f1bf-48b6-8b9b-4a989d46add9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b48f387-c08a-488d-9eb1-503912794605', 'volume_name': 'volume-7b48f387-c08a-488d-9eb1-503912794605', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c483a8-a190-40ea-9d0d-726af0e0fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c483a8-a190-40ea-9d0d-726af0e0fe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022cd132-0822-4044-91c7-8dcd6f8371cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:31 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Volume 7b48f387-c08a-488d-9eb1-503912794605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b48f387-c08a-488d-9eb1-503912794605', 'volume_size': 1} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-701124156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b48f387-c08a-488d-9eb1-503912794605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e16662350754443b690e77877437ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:06:31Z,use_quota=True,user_id='7abc31e384944f6da86059422e85462d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Creating volume 7b48f387-c08a-488d-9eb1-503912794605 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:06:31 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:06:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:31 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605 1073741824 Sep 01 01:06:31 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:32 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605 1073741824" returned: 0 in 0.831s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:32 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605 Sep 01 01:06:32 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:32 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605" returned: 0 in 0.387s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:06:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022cd132-0822-4044-91c7-8dcd6f8371cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b48f387-c08a-488d-9eb1-503912794605', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0597943-1ce8-4acc-9b0a-959b8cdbf438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:32 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Volume volume-7b48f387-c08a-488d-9eb1-503912794605 (7b48f387-c08a-488d-9eb1-503912794605): created successfully Sep 01 01:06:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0597943-1ce8-4acc-9b0a-959b8cdbf438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Flow 'volume_create_manager' (2d182da0-0a37-4831-99a3-706d4459989c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:06:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-31adfd3e-7a97-4bdf-a47d-b019f03f81a5 tempest-AttachVolumeTestJSON-123863135 None] Created volume successfully. Sep 01 01:06:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] GroupSnapshot e1b7a2d0-6e3a-4f6a-847f-2a23ccbee658: creating. Sep 01 01:06:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] Group snapshot e1b7a2d0-6e3a-4f6a-847f-2a23ccbee658: creating. {{(pid=87064) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 01:06:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] Creating offline snapshot f98fad22-9583-44c2-b9d1-fded444154ba of volume e55c5233-457e-4e0a-98a7-df04a6bc1b91 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:06:33 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30666ac-c653-49ab-9d4d-8a59f551ed8e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:33 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 Sep 01 01:06:33 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:33 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91" returned: 0 in 0.488s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:33 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba 1G Sep 01 01:06:33 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:34 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba 1G" returned: 0 in 0.612s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-a3e67e99-855d-46f1-8046-5ef47266b070 req-18882db8-8ef3-4ef2-92f1-9e292baa4a61 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:34 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba Sep 01 01:06:34 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:34 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba" returned: 0 in 0.321s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:34 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:06:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:34 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba Sep 01 01:06:34 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:34 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba" returned: 0 in 0.273s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:34 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.info Sep 01 01:06:34 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:35 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.info" returned: 0 in 0.410s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:35 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:06:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:35 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.info Sep 01 01:06:35 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:35 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.info" returned: 0 in 0.274s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-a3e67e99-855d-46f1-8046-5ef47266b070 req-18882db8-8ef3-4ef2-92f1-9e292baa4a61 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.330s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-a3e67e99-855d-46f1-8046-5ef47266b070 req-18882db8-8ef3-4ef2-92f1-9e292baa4a61 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-a3e67e99-855d-46f1-8046-5ef47266b070 req-18882db8-8ef3-4ef2-92f1-9e292baa4a61 tempest-AttachVolumeTestJSON-123863135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-7b48f387-c08a-488d-9eb1-503912794605', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35d5f251-532f-441b-8036-7f42a5c27a66', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:06:35 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-dbf375d3-1ad9-4664-8aee-e5e2c2c00212 tempest-GroupSnapshotsTest-649271858 None] group_snapshot e1b7a2d0-6e3a-4f6a-847f-2a23ccbee658: created successfully Sep 01 01:06:35 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-a3e67e99-855d-46f1-8046-5ef47266b070 req-18882db8-8ef3-4ef2-92f1-9e292baa4a61 tempest-AttachVolumeTestJSON-123863135 None] attachment_update completed successfully. Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-f98fad22-9583-44c2-b9d1-fded444154ba-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" by "_create_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-f98fad22-9583-44c2-b9d1-fded444154ba-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Creating volume ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 from snapshot f98fad22-9583-44c2-b9d1-fded444154ba {{(pid=87064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:37 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] snapshot: f98fad22-9583-44c2-b9d1-fded444154ba, volume: ae5d3a92-a0a8-4c09-a9c5-a50320b4e204, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:06:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:06:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:06:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ba2844-9c4f-4272-91c8-edb370060df6]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:38 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba Sep 01 01:06:38 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:38 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba" returned: 0 in 0.527s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:06:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a92b62-12a4-43ed-bed6-eb2f2fb10f7e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:38 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 Sep 01 01:06:38 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:39 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91" returned: 0 in 0.507s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:06:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:06:39 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:06:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:39 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 Sep 01 01:06:39 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:45 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" returned: 0 in 6.581s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:45 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:06:45 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Converted 1024.00 MB image at 155.53 MB/s Sep 01 01:06:45 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:06:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:45 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 Sep 01 01:06:45 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:46 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" returned: 0 in 0.512s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" released by "_copy_volume_from_snapshot" :: held 8.300s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-f98fad22-9583-44c2-b9d1-fded444154ba-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" released by "_create_volume_from_snapshot" :: held 8.428s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.457s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:46 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-79e03f5b-7ed4-4864-9a30-5a204ca7e7ba tempest-GroupSnapshotsTest-649271858 None] Create group from source-snapshot-e1b7a2d0-6e3a-4f6a-847f-2a23ccbee658 completed successfully. Sep 01 01:06:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" acquired by "delete_volume" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:48 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e88ed4-4d67-424b-8723-4e9101392f73]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:48 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 Sep 01 01:06:48 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:49 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" returned: 0 in 0.765s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:49 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204 Sep 01 01:06:49 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Flow 'volume_create_manager' (d50fca72-c040-4c34-96c7-ed231e7cfe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02039863-7ec4-48e9-9735-2ee33a70695c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02039863-7ec4-48e9-9735-2ee33a70695c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1333729026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac093ba-1896-48d2-ad34-7a7ecf014337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9191b55354de4ee1a46707fa208c9bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:06:49Z,use_quota=True,user_id='3da97dd9e4694f71964b6df902e3931e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec31c64-1af2-4acf-abed-c93fdd94946f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec31c64-1af2-4acf-abed-c93fdd94946f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6adc24d-aa35-4ef4-a261-99c26db5c335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6adc24d-aa35-4ef4-a261-99c26db5c335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac093ba-1896-48d2-ad34-7a7ecf014337', 'volume_name': 'volume-fac093ba-1896-48d2-ad34-7a7ecf014337', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77499fc6-e6bd-42cb-9a6a-936fe22aa6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77499fc6-e6bd-42cb-9a6a-936fe22aa6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85230cba-51a1-4aa1-a801-488f33179848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:49 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Volume fac093ba-1896-48d2-ad34-7a7ecf014337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac093ba-1896-48d2-ad34-7a7ecf014337', 'volume_size': 1} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1333729026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac093ba-1896-48d2-ad34-7a7ecf014337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9191b55354de4ee1a46707fa208c9bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:06:49Z,use_quota=True,user_id='3da97dd9e4694f71964b6df902e3931e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Creating volume fac093ba-1896-48d2-ad34-7a7ecf014337 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:06:49 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:06:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:49 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337 1073741824 Sep 01 01:06:49 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:50 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" returned: 0 in 0.803s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-ae5d3a92-a0a8-4c09-a9c5-a50320b4e204" released by "delete_volume" :: held 1.721s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Created reservations ['7886ba7b-498e-4e93-9fea-5c7ae33a226f'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:06:50 devstack cinder-volume[87064]: WARNING cinder.quota [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1059790813 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1059790813, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:06:50 devstack cinder-volume[87064]: WARNING cinder.quota [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1059790813 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1059790813, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Created reservations ['892e4d04-b5ed-47f8-8a1a-860c6508257d', '798b6ac8-dd2c-44bd-b3a6-17ed20aaecb8', '73ac2042-cb5a-43b2-b6bf-83f934025501', 'a0354b3f-f69f-4fe6-bfea-6d17c3d42fee'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:50 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:06:50 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:50 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337 1073741824" returned: 0 in 0.963s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:50 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337 Sep 01 01:06:50 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:50 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.311s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:50 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:06:51 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-645b6ea7-eb22-460f-9098-b538d9ce12aa tempest-GroupSnapshotsTest-649271858 None] Delete group completed successfully. Sep 01 01:06:51 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337" returned: 0 in 0.364s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85230cba-51a1-4aa1-a801-488f33179848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac093ba-1896-48d2-ad34-7a7ecf014337', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e1f4b6-d830-459c-bd3d-a6bbcdfa312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:06:51 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Volume volume-fac093ba-1896-48d2-ad34-7a7ecf014337 (fac093ba-1896-48d2-ad34-7a7ecf014337): created successfully Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e1f4b6-d830-459c-bd3d-a6bbcdfa312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Flow 'volume_create_manager' (d50fca72-c040-4c34-96c7-ed231e7cfe46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:06:51 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] group_snapshot e1b7a2d0-6e3a-4f6a-847f-2a23ccbee658: deleting Sep 01 01:06:51 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-88e13555-9acc-496f-a3c6-a57baf6471fd tempest-AttachVolumeNegativeTest-355458312 None] Created volume successfully. Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] group_snapshot e1b7a2d0-6e3a-4f6a-847f-2a23ccbee658: deleting {{(pid=87064) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-e55c5233-457e-4e0a-98a7-df04a6bc1b91" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-e55c5233-457e-4e0a-98a7-df04a6bc1b91" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-f98fad22-9583-44c2-b9d1-fded444154ba" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-f98fad22-9583-44c2-b9d1-fded444154ba" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Deleting offline snapshot f98fad22-9583-44c2-b9d1-fded444154ba of volume e55c5233-457e-4e0a-98a7-df04a6bc1b91 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] snapshot_file for this snap is: volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dfbc0f-e864-4f65-b871-1a931f7385c8]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:51 devstack sudo[92323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba Sep 01 01:06:51 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:51 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba" returned: 0 in 0.558s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f349131-9bbf-44a8-8391-7c642b06c257]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:52 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 Sep 01 01:06:52 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-6cd5d649-2bf8-4a61-a864-bc189ca98871 req-513cfc96-981d-4938-9435-d5be87daa270 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-6cd5d649-2bf8-4a61-a864-bc189ca98871 req-513cfc96-981d-4938-9435-d5be87daa270 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:52 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:06:52 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-6cd5d649-2bf8-4a61-a864-bc189ca98871 req-513cfc96-981d-4938-9435-d5be87daa270 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-6cd5d649-2bf8-4a61-a864-bc189ca98871 req-513cfc96-981d-4938-9435-d5be87daa270 tempest-AttachVolumeNegativeTest-355458312 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-fac093ba-1896-48d2-ad34-7a7ecf014337', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d7d4fbc-bf13-4227-a591-d486ff861cf4', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:06:52 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91" returned: 0 in 0.846s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:52 devstack sudo[92349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba Sep 01 01:06:52 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:52 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-6cd5d649-2bf8-4a61-a864-bc189ca98871 req-513cfc96-981d-4938-9435-d5be87daa270 tempest-AttachVolumeNegativeTest-355458312 None] attachment_update completed successfully. Sep 01 01:06:53 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.506s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:06:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:06:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 8 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:06:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:06:53 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba" returned: 0 in 0.804s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:53 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba Sep 01 01:06:53 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:54 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91.f98fad22-9583-44c2-b9d1-fded444154ba" returned: 0 in 0.348s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-f98fad22-9583-44c2-b9d1-fded444154ba" released by "_delete_snapshot" :: held 2.706s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-e55c5233-457e-4e0a-98a7-df04a6bc1b91" released by "delete_snapshot" :: held 2.736s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:54 devstack cinder-volume[87064]: WARNING cinder.quota [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1059790813 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1059790813, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:06:54 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] Created reservations ['9264a8d2-c5cf-4072-877f-4e5c45eee473', '6e01074b-18f3-4960-8d7f-383b14c39b30', '66dd3ab8-98ee-4f7a-acd8-3bf2b5e8c553', '424c7a70-f408-44f8-bdd6-c77b09f7f5e5'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:06:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3531701f-0a3b-4930-9d30-074360dd5829 tempest-GroupSnapshotsTest-649271858 None] group_snapshot e1b7a2d0-6e3a-4f6a-847f-2a23ccbee658: deleted successfully Sep 01 01:06:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-e55c5233-457e-4e0a-98a7-df04a6bc1b91" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:06:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-e55c5233-457e-4e0a-98a7-df04a6bc1b91" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:06:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cc2640-3ba3-4ab9-851a-c1443e249512]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:06:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:55 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 Sep 01 01:06:55 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:55 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=66,cinder:UPDATE=51,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:06:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-58eefb60-670d-4be0-a1de-94c7af67fbbc req-96ccb15f-4c87-4852-82e8-29e1c4c5c319 tempest-AttachVolumeNegativeTest-355458312 None] Terminate volume connection completed successfully. Sep 01 01:06:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-58eefb60-670d-4be0-a1de-94c7af67fbbc req-96ccb15f-4c87-4852-82e8-29e1c4c5c319 tempest-AttachVolumeNegativeTest-355458312 None] Deleting attachment 1d7d4fbc-bf13-4227-a591-d486ff861cf4. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:06:55 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91" returned: 0 in 0.498s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:55 devstack sudo[92377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91 Sep 01 01:06:55 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:56 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e55c5233-457e-4e0a-98a7-df04a6bc1b91" returned: 0 in 0.387s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-e55c5233-457e-4e0a-98a7-df04a6bc1b91" released by "delete_volume" :: held 0.960s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:06:56 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Created reservations ['e3243494-1437-4d7a-a504-29db9c3787e8'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:06:56 devstack cinder-volume[87064]: WARNING cinder.db.api [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1059790813'] Sep 01 01:06:56 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Created reservations ['8fb1bdbd-f3e7-4973-aa64-580aca11b175', '848bce7a-23d8-444c-b6d1-9a7f4d823496', '21e21d55-6abe-4d95-a0dd-cbfe2850cad8', 'b0202eb3-ece3-4152-a750-aad6c3dde5dd'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:06:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:06:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:06:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:06:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:06:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:06:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:06:56 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:06:56 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:06:57 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Sep 01 01:06:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.522s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:06:57 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:06:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c5c44af9-2f14-46d4-b2c7-b7ea8e5ca56c tempest-GroupSnapshotsTest-649271858 None] Delete group completed successfully. Sep 01 01:06:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-30b49c76-1c08-49f5-a73f-bc210b37fae5 tempest-GroupSnapshotsTest-649271858 None] Group tempest-GroupSnapshotsTest-Group-906218562: creating Sep 01 01:06:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-30b49c76-1c08-49f5-a73f-bc210b37fae5 tempest-GroupSnapshotsTest-649271858 None] Group tempest-GroupSnapshotsTest-Group-906218562: created successfully Sep 01 01:06:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-30b49c76-1c08-49f5-a73f-bc210b37fae5 tempest-GroupSnapshotsTest-649271858 None] Create group completed successfully. Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=84,cinder:UPDATE=82,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Flow 'volume_create_manager' (79da5e99-d111-4f2e-b674-e17c56e82d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa058a1-19cf-4c74-be22-2122e40ce94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa058a1-19cf-4c74-be22-2122e40ce94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-636405589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8f7acb0-c1eb-4245-86f4-0e0eac8b050c,host='devstack@QuobyteHD#QuobyteHD',id=72e251fe-6467-4414-b1dd-a5f64f4ccedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a072f674603458fa8b78eaadc2a8739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:07:01Z,use_quota=True,user_id='484dcaad73bf4c328b62c97a594ce9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0033d1-62be-4716-bf7e-969dd61c7ed3),volume_type_id=9b0033d1-62be-4716-bf7e-969dd61c7ed3)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f04780-e218-4b74-bc0a-41c3d1ca7d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f04780-e218-4b74-bc0a-41c3d1ca7d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd85c5b-8658-407b-8ef2-cadcc61fe876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd85c5b-8658-407b-8ef2-cadcc61fe876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e251fe-6467-4414-b1dd-a5f64f4ccedc', 'volume_name': 'volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab11875-a44c-472d-849b-df710e97f28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab11875-a44c-472d-849b-df710e97f28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e26a038-fea1-4625-b1eb-2e694a85bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:01 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Volume 72e251fe-6467-4414-b1dd-a5f64f4ccedc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc', 'volume_size': 1} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e8f7acb0-c1eb-4245-86f4-0e0eac8b050c,created_at=2026-08-31T23:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-636405589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8f7acb0-c1eb-4245-86f4-0e0eac8b050c,host='devstack@QuobyteHD#QuobyteHD',id=72e251fe-6467-4414-b1dd-a5f64f4ccedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a072f674603458fa8b78eaadc2a8739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:07:01Z,use_quota=True,user_id='484dcaad73bf4c328b62c97a594ce9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0033d1-62be-4716-bf7e-969dd61c7ed3),volume_type_id=9b0033d1-62be-4716-bf7e-969dd61c7ed3)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Creating volume 72e251fe-6467-4414-b1dd-a5f64f4ccedc {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:07:01 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:07:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:01 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc 1073741824 Sep 01 01:07:01 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:02 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc 1073741824" returned: 0 in 0.830s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:02 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc Sep 01 01:07:02 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:03 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc" returned: 0 in 0.394s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:03 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:07:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e26a038-fea1-4625-b1eb-2e694a85bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e976f29f-d424-4b8a-901a-d434303f4f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:03 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Volume volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc (72e251fe-6467-4414-b1dd-a5f64f4ccedc): created successfully Sep 01 01:07:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e976f29f-d424-4b8a-901a-d434303f4f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Flow 'volume_create_manager' (79da5e99-d111-4f2e-b674-e17c56e82d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:07:03 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-1fb2161d-d687-493f-a601-75576ae14037 tempest-GroupSnapshotsTest-649271858 None] Created volume successfully. Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Flow 'volume_create_manager' (9bc39497-e4f5-4e1f-ab59-c48cdcd06ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2c4480-5bac-4d14-b6ab-6c2480788b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2c4480-5bac-4d14-b6ab-6c2480788b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1425059744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8f7acb0-c1eb-4245-86f4-0e0eac8b050c,host='devstack@QuobyteHD#QuobyteHD',id=97e712c1-f11e-4570-9b7d-79881c9a7244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a072f674603458fa8b78eaadc2a8739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:07:05Z,use_quota=True,user_id='484dcaad73bf4c328b62c97a594ce9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0033d1-62be-4716-bf7e-969dd61c7ed3),volume_type_id=9b0033d1-62be-4716-bf7e-969dd61c7ed3)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1c0891-c904-422a-86ea-5930427a0b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1c0891-c904-422a-86ea-5930427a0b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e7533f-c01d-4bde-81d6-1cd73bd13a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e7533f-c01d-4bde-81d6-1cd73bd13a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e712c1-f11e-4570-9b7d-79881c9a7244', 'volume_name': 'volume-97e712c1-f11e-4570-9b7d-79881c9a7244', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf538900-b11d-4bc9-a7ac-dba7154b41de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf538900-b11d-4bc9-a7ac-dba7154b41de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef3737a-26aa-40e0-8bd3-969946fcaf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:05 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Volume 97e712c1-f11e-4570-9b7d-79881c9a7244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e712c1-f11e-4570-9b7d-79881c9a7244', 'volume_size': 1} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e8f7acb0-c1eb-4245-86f4-0e0eac8b050c,created_at=2026-08-31T23:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1425059744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8f7acb0-c1eb-4245-86f4-0e0eac8b050c,host='devstack@QuobyteHD#QuobyteHD',id=97e712c1-f11e-4570-9b7d-79881c9a7244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a072f674603458fa8b78eaadc2a8739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:07:05Z,use_quota=True,user_id='484dcaad73bf4c328b62c97a594ce9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0033d1-62be-4716-bf7e-969dd61c7ed3),volume_type_id=9b0033d1-62be-4716-bf7e-969dd61c7ed3)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Creating volume 97e712c1-f11e-4570-9b7d-79881c9a7244 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:07:05 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:07:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:05 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 1073741824 Sep 01 01:07:05 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:06 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 1073741824" returned: 0 in 0.760s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:06 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 Sep 01 01:07:06 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:06 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244" returned: 0 in 0.478s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:07:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef3737a-26aa-40e0-8bd3-969946fcaf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e712c1-f11e-4570-9b7d-79881c9a7244', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d882619b-76f7-4262-bba4-a834fe0caae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:06 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Volume volume-97e712c1-f11e-4570-9b7d-79881c9a7244 (97e712c1-f11e-4570-9b7d-79881c9a7244): created successfully Sep 01 01:07:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d882619b-76f7-4262-bba4-a834fe0caae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Flow 'volume_create_manager' (9bc39497-e4f5-4e1f-ab59-c48cdcd06ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:07:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-71be14d0-87e4-4a86-bcc4-06a2e48cfcfd tempest-GroupSnapshotsTest-649271858 None] Created volume successfully. Sep 01 01:07:08 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-dbcc6d18-5e96-4a7b-b921-e4538360d3e0 tempest-GroupSnapshotsTest-649271858 None] Update group completed successfully. Sep 01 01:07:09 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6ddf7bf0-45a6-4716-b56c-6fb3fe59add1 tempest-GroupSnapshotsTest-649271858 None] Update group completed successfully. Sep 01 01:07:10 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b34c7e22-4f3f-4e43-b74c-a6f02606b537 tempest-GroupSnapshotsTest-649271858 None] Update group completed successfully. Sep 01 01:07:11 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5119408a-82db-492c-aada-a517c00f7b81 tempest-GroupSnapshotsTest-649271858 None] Update group completed successfully. Sep 01 01:07:13 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] GroupSnapshot 9828846f-4c56-48ab-93ad-a5b48ed768a9: creating. Sep 01 01:07:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Group snapshot 9828846f-4c56-48ab-93ad-a5b48ed768a9: creating. {{(pid=87064) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 01:07:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Creating offline snapshot 5ae29328-00fb-494e-96f9-e1eea637c141 of volume 72e251fe-6467-4414-b1dd-a5f64f4ccedc {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:07:13 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bec692f-f035-47f6-ba0b-e24f0a0ad8ae]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:13 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-9d778e7b-30cd-493a-b7ec-d6d9200e3a6e req-ce47d277-ac7d-403c-8a84-4e7aeb624b22 tempest-AttachVolumeTestJSON-123863135 None] Terminate volume connection completed successfully. Sep 01 01:07:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-9d778e7b-30cd-493a-b7ec-d6d9200e3a6e req-ce47d277-ac7d-403c-8a84-4e7aeb624b22 tempest-AttachVolumeTestJSON-123863135 None] Deleting attachment 35d5f251-532f-441b-8036-7f42a5c27a66. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:07:13 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc Sep 01 01:07:13 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:14 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc" returned: 0 in 0.653s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:14 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 1G Sep 01 01:07:14 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:15 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 1G" returned: 0 in 1.249s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:15 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 Sep 01 01:07:15 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:16 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141" returned: 0 in 0.581s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:16 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:07:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:16 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 Sep 01 01:07:16 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:16 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141" returned: 0 in 0.465s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:16 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.info Sep 01 01:07:16 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:17 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.info" returned: 0 in 0.339s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:17 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:07:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:17 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.info Sep 01 01:07:17 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:17 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.info" returned: 0 in 0.325s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.790s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Creating offline snapshot a833b785-49af-453f-8d15-1992f0e0a72a of volume 97e712c1-f11e-4570-9b7d-79881c9a7244 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:07:17 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14e7e05-cf3f-4a12-aa59-2fe3ef471ae1]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:17 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 Sep 01 01:07:17 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:18 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244" returned: 0 in 0.923s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:18 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a 1G Sep 01 01:07:18 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:19 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a 1G" returned: 0 in 1.279s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e712c1-f11e-4570-9b7d-79881c9a7244 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:19 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e712c1-f11e-4570-9b7d-79881c9a7244 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a Sep 01 01:07:19 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:20 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e712c1-f11e-4570-9b7d-79881c9a7244 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a" returned: 0 in 0.853s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:20 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:07:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:20 devstack sudo[92788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a Sep 01 01:07:20 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a" returned: 0 in 0.518s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:21 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:21 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.info Sep 01 01:07:21 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:21 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.info" returned: 0 in 0.642s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:21 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:07:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:21 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.info Sep 01 01:07:21 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:22 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.info" returned: 0 in 0.949s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.378s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:23 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-aec0e213-3b7d-4c4d-90ab-c989a26e6bdc tempest-GroupSnapshotsTest-649271858 None] group_snapshot 9828846f-4c56-48ab-93ad-a5b48ed768a9: created successfully Sep 01 01:07:23 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] group_snapshot 9828846f-4c56-48ab-93ad-a5b48ed768a9: deleting Sep 01 01:07:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] group_snapshot 9828846f-4c56-48ab-93ad-a5b48ed768a9: deleting {{(pid=87064) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 01:07:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-72e251fe-6467-4414-b1dd-a5f64f4ccedc" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-72e251fe-6467-4414-b1dd-a5f64f4ccedc" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-5ae29328-00fb-494e-96f9-e1eea637c141" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-5ae29328-00fb-494e-96f9-e1eea637c141" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Deleting offline snapshot 5ae29328-00fb-494e-96f9-e1eea637c141 of volume 72e251fe-6467-4414-b1dd-a5f64f4ccedc {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:07:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] snapshot_file for this snap is: volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:07:24 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7527aa7-2f9f-419e-a47f-1ed62bb6a71a]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:24 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 Sep 01 01:07:24 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:24 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141" returned: 0 in 0.650s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:07:24 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f348232e-4c51-43db-afe9-81e9e06ab786]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:24 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc Sep 01 01:07:24 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:25 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc" returned: 0 in 0.460s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:25 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 Sep 01 01:07:25 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:25 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141" returned: 0 in 0.443s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:25 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141 Sep 01 01:07:25 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:26 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc.5ae29328-00fb-494e-96f9-e1eea637c141" returned: 0 in 0.404s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-5ae29328-00fb-494e-96f9-e1eea637c141" released by "_delete_snapshot" :: held 2.124s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-72e251fe-6467-4414-b1dd-a5f64f4ccedc" released by "delete_snapshot" :: held 2.176s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-97e712c1-f11e-4570-9b7d-79881c9a7244" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-97e712c1-f11e-4570-9b7d-79881c9a7244" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-a833b785-49af-453f-8d15-1992f0e0a72a" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-a833b785-49af-453f-8d15-1992f0e0a72a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Deleting offline snapshot a833b785-49af-453f-8d15-1992f0e0a72a of volume 97e712c1-f11e-4570-9b7d-79881c9a7244 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] snapshot_file for this snap is: volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf40232-9b6e-4dd4-abf3-de7fa6cacb99]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:26 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a Sep 01 01:07:26 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:26 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a" returned: 0 in 0.466s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e712c1-f11e-4570-9b7d-79881c9a7244(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafffff0-5f81-487e-b942-ca8a977122ab]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:26 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 Sep 01 01:07:26 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:27 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244" returned: 0 in 0.498s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:27 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a Sep 01 01:07:27 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:27 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a" returned: 0 in 0.460s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:27 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a Sep 01 01:07:27 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:28 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244.a833b785-49af-453f-8d15-1992f0e0a72a" returned: 0 in 0.288s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-a833b785-49af-453f-8d15-1992f0e0a72a" released by "_delete_snapshot" :: held 1.850s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-97e712c1-f11e-4570-9b7d-79881c9a7244" released by "delete_snapshot" :: held 1.885s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:28 devstack cinder-volume[87064]: WARNING cinder.quota [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1798473312 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1798473312, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:07:28 devstack cinder-volume[87064]: WARNING cinder.quota [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1798473312 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1798473312, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:07:28 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Created reservations ['77eff1b1-493b-4218-8148-1d767eb00c0b', '9d657fa6-b3f3-4f5b-9379-ea139f15d09b', '00bd9553-fb51-4482-82f0-434e4159561a', 'ff22fd8a-d2b2-41d0-b1e8-fcf864fabf93'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:07:28 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] Created reservations ['4a79022a-aaca-42fd-beba-2b6f5b387449', 'f2015785-aba3-49fd-aea3-864812b70526', 'fe2d8694-1a2e-4818-b757-7b1bfa8f0dec', '30c18b3d-1603-44ab-bc4a-dc2dd6bb2fcf'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:07:28 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d7500728-fc39-48f9-9054-b36e3ddbe113 tempest-GroupSnapshotsTest-649271858 None] group_snapshot 9828846f-4c56-48ab-93ad-a5b48ed768a9: deleted successfully Sep 01 01:07:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-72e251fe-6467-4414-b1dd-a5f64f4ccedc" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-72e251fe-6467-4414-b1dd-a5f64f4ccedc" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:29 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf833255-6a87-4f63-b49e-9ec15bc44513]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:29 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc Sep 01 01:07:29 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:30 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc" returned: 0 in 0.801s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:07:30 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc Sep 01 01:07:30 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Flow 'volume_create_manager' (6f3f6bfc-08a1-4340-bb4c-42312117cad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18ce40f-bb87-4067-bbca-2ff414e10a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18ce40f-bb87-4067-bbca-2ff414e10a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-224811258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a564fb07-53ed-433f-b998-69139e9469f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173192acc1cc4a2197c91b6f7939854c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:07:30Z,use_quota=True,user_id='61ad5c970c4e4dcbaefa3dbcd4d1da75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12dfda1-d8b2-4898-8c56-204381e9b006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12dfda1-d8b2-4898-8c56-204381e9b006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72effb10-5aa4-493a-a081-4dfb75e7cc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72effb10-5aa4-493a-a081-4dfb75e7cc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a564fb07-53ed-433f-b998-69139e9469f1', 'volume_name': 'volume-a564fb07-53ed-433f-b998-69139e9469f1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d350f48-110f-4087-8069-07d245be01ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d350f48-110f-4087-8069-07d245be01ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e23a020-8901-4dda-845e-214a73c04845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Volume a564fb07-53ed-433f-b998-69139e9469f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a564fb07-53ed-433f-b998-69139e9469f1', 'volume_size': 1} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-224811258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a564fb07-53ed-433f-b998-69139e9469f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173192acc1cc4a2197c91b6f7939854c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:07:30Z,use_quota=True,user_id='61ad5c970c4e4dcbaefa3dbcd4d1da75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Creating volume a564fb07-53ed-433f-b998-69139e9469f1 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:07:30 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:30 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1 1073741824 Sep 01 01:07:30 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:30 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-72e251fe-6467-4414-b1dd-a5f64f4ccedc" returned: 0 in 0.557s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:31 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-72e251fe-6467-4414-b1dd-a5f64f4ccedc" released by "delete_volume" :: held 1.575s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:31 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-97e712c1-f11e-4570-9b7d-79881c9a7244" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:31 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-97e712c1-f11e-4570-9b7d-79881c9a7244" acquired by "delete_volume" :: waited 0.036s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:31 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4349bb7-a45f-482b-9529-2bfed31be271]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:31 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 Sep 01 01:07:31 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:31 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1 1073741824" returned: 0 in 0.936s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:31 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1 Sep 01 01:07:31 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:31 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244" returned: 0 in 0.723s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:31 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244 Sep 01 01:07:31 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:32 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1" returned: 0 in 0.482s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e23a020-8901-4dda-845e-214a73c04845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a564fb07-53ed-433f-b998-69139e9469f1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0973d2b-4a26-43c9-81f0-191d92515520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:32 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Volume volume-a564fb07-53ed-433f-b998-69139e9469f1 (a564fb07-53ed-433f-b998-69139e9469f1): created successfully Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0973d2b-4a26-43c9-81f0-191d92515520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Flow 'volume_create_manager' (6f3f6bfc-08a1-4340-bb4c-42312117cad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:07:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3573c465-abbd-4e2b-a276-dd02b5d06089 tempest-ServerActionsTestOtherA-2054217892 None] Created volume successfully. Sep 01 01:07:32 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-97e712c1-f11e-4570-9b7d-79881c9a7244" returned: 0 in 0.554s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-97e712c1-f11e-4570-9b7d-79881c9a7244" released by "delete_volume" :: held 1.404s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Created reservations ['32c1d2cc-0034-4acb-91cb-3daff869b949'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:07:32 devstack cinder-volume[87064]: WARNING cinder.quota [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1798473312 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1798473312, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Created reservations ['d1585c93-b509-4bc4-8f3a-37ed417887d0', '4d757962-9453-49e7-81b6-35b1cce8df35', 'e6ed4b11-8c1f-451a-9208-d171044d231d', 'e340bd6a-c15d-4b02-8022-ea7962ef51fe'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:07:32 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Created reservations ['c04d2919-32b4-461d-9a63-90163114e38a', '3f4b9b4d-cf21-48ce-8c1e-edbd5898eb72', 'a3b19a8d-8abb-4237-bbc0-653976e3cf9c', '6670e2c1-9019-4be1-b1cd-7dc9a9b9d179'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:07:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:07:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:07:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:33 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:07:33 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:33 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.379s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:33 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:07:33 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5c779914-39b8-43cc-889e-f2bb612e0fe9 tempest-GroupSnapshotsTest-649271858 None] Delete group completed successfully. Sep 01 01:07:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b2cd41c8-80a3-4b11-ba5d-da2f69cf4ab4 tempest-GroupSnapshotsTest-649271858 None] Group tempest-GroupSnapshotsTest-Group-803278612: creating Sep 01 01:07:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b2cd41c8-80a3-4b11-ba5d-da2f69cf4ab4 tempest-GroupSnapshotsTest-649271858 None] Group tempest-GroupSnapshotsTest-Group-803278612: created successfully Sep 01 01:07:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b2cd41c8-80a3-4b11-ba5d-da2f69cf4ab4 tempest-GroupSnapshotsTest-649271858 None] Create group completed successfully. Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Flow 'volume_create_manager' (f4f7d26f-9f1e-490b-886e-f1b4706b2799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e549d216-1573-48a4-9698-643b57166290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e549d216-1573-48a4-9698-643b57166290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1646999561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09c001a1-369b-4394-a910-7501bff5afc6,host='devstack@QuobyteHD#QuobyteHD',id=9cbc4042-6c62-46da-bf8e-30d7e8afc587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a072f674603458fa8b78eaadc2a8739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:07:36Z,use_quota=True,user_id='484dcaad73bf4c328b62c97a594ce9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6528e1a3-422b-43cd-9e96-39d490d218b9),volume_type_id=6528e1a3-422b-43cd-9e96-39d490d218b9)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3350af1c-517f-4d74-ae64-d947fabda4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3350af1c-517f-4d74-ae64-d947fabda4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842bea2f-96b6-4f6c-a277-94acdc40fa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842bea2f-96b6-4f6c-a277-94acdc40fa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cbc4042-6c62-46da-bf8e-30d7e8afc587', 'volume_name': 'volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55258d76-6941-4a78-8c3b-3031defaae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55258d76-6941-4a78-8c3b-3031defaae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4251c99a-18c2-47e0-85dd-b2f80dfb7599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:36 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Volume 9cbc4042-6c62-46da-bf8e-30d7e8afc587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587', 'volume_size': 1} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=09c001a1-369b-4394-a910-7501bff5afc6,created_at=2026-08-31T23:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1646999561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09c001a1-369b-4394-a910-7501bff5afc6,host='devstack@QuobyteHD#QuobyteHD',id=9cbc4042-6c62-46da-bf8e-30d7e8afc587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a072f674603458fa8b78eaadc2a8739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:07:36Z,use_quota=True,user_id='484dcaad73bf4c328b62c97a594ce9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6528e1a3-422b-43cd-9e96-39d490d218b9),volume_type_id=6528e1a3-422b-43cd-9e96-39d490d218b9)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Creating volume 9cbc4042-6c62-46da-bf8e-30d7e8afc587 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:07:36 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:36 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 1073741824 Sep 01 01:07:36 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:36 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 1073741824" returned: 0 in 0.606s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:37 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 Sep 01 01:07:37 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:37 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587" returned: 0 in 0.430s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:37 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:07:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4251c99a-18c2-47e0-85dd-b2f80dfb7599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950003e5-0515-42e9-906e-12594f82e58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:37 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Volume volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 (9cbc4042-6c62-46da-bf8e-30d7e8afc587): created successfully Sep 01 01:07:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950003e5-0515-42e9-906e-12594f82e58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Flow 'volume_create_manager' (f4f7d26f-9f1e-490b-886e-f1b4706b2799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:07:37 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b47c7d70-e639-4e95-aaad-495739288fab tempest-GroupSnapshotsTest-649271858 None] Created volume successfully. Sep 01 01:07:39 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] GroupSnapshot ea692d2d-07e2-48cc-9a3d-eda0b0590e9a: creating. Sep 01 01:07:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] Group snapshot ea692d2d-07e2-48cc-9a3d-eda0b0590e9a: creating. {{(pid=87064) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 01:07:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] Creating offline snapshot eec05e4b-20b1-47c7-b7ad-09adcaee21a0 of volume 9cbc4042-6c62-46da-bf8e-30d7e8afc587 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:07:39 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f0cc10-4214-4999-8339-4f0375e3f453]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:39 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 Sep 01 01:07:39 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:39 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587" returned: 0 in 0.531s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:39 devstack sudo[93034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 1G Sep 01 01:07:39 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:40 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 1G" returned: 0 in 0.666s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:40 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 Sep 01 01:07:40 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:40 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0" returned: 0 in 0.377s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:40 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:07:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:40 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 Sep 01 01:07:40 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:41 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0" returned: 0 in 0.605s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:41 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.info Sep 01 01:07:41 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:42 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.info" returned: 0 in 0.540s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:42 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:42 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.info Sep 01 01:07:42 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Flow 'volume_create_manager' (97079618-7940-4ac7-a58e-25bc2fc52bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d226a2-dada-40dd-a231-92c893234ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d226a2-dada-40dd-a231-92c893234ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-103262757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9191b55354de4ee1a46707fa208c9bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:07:42Z,use_quota=True,user_id='3da97dd9e4694f71964b6df902e3931e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6b7f69-4937-4983-b750-82687f78898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6b7f69-4937-4983-b750-82687f78898d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3725a697-a4f5-4d4b-9330-eedade5acde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3725a697-a4f5-4d4b-9330-eedade5acde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a', 'volume_name': 'volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdc9fae-3984-4199-b27d-13670314e89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdc9fae-3984-4199-b27d-13670314e89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7078a170-f70a-4f08-b64d-1ea79d1301ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:42 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Volume 631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a', 'volume_size': 1} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:42 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.info" returned: 0 in 0.442s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.359s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.194s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-103262757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9191b55354de4ee1a46707fa208c9bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:07:42Z,use_quota=True,user_id='3da97dd9e4694f71964b6df902e3931e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Creating volume 631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:07:42 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:07:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:42 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a 1073741824 Sep 01 01:07:42 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:42 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-eb36c68b-5717-41c4-a51c-9fd76b2da750 tempest-GroupSnapshotsTest-649271858 None] group_snapshot ea692d2d-07e2-48cc-9a3d-eda0b0590e9a: created successfully Sep 01 01:07:43 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a 1073741824" returned: 0 in 0.752s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:43 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a Sep 01 01:07:43 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:43 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] group_snapshot ea692d2d-07e2-48cc-9a3d-eda0b0590e9a: deleting Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] group_snapshot ea692d2d-07e2-48cc-9a3d-eda0b0590e9a: deleting {{(pid=87064) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 01:07:43 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a" returned: 0 in 0.437s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-9cbc4042-6c62-46da-bf8e-30d7e8afc587" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7078a170-f70a-4f08-b64d-1ea79d1301ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2db637-273f-4b04-9d4b-a6d012d3ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-9cbc4042-6c62-46da-bf8e-30d7e8afc587" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-eec05e4b-20b1-47c7-b7ad-09adcaee21a0" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:43 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Volume volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a (631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a): created successfully Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2db637-273f-4b04-9d4b-a6d012d3ead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Flow 'volume_create_manager' (97079618-7940-4ac7-a58e-25bc2fc52bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-eec05e4b-20b1-47c7-b7ad-09adcaee21a0" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Deleting offline snapshot eec05e4b-20b1-47c7-b7ad-09adcaee21a0 of volume 9cbc4042-6c62-46da-bf8e-30d7e8afc587 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] snapshot_file for this snap is: volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:07:43 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-cf61e84e-a255-45f8-8c24-e78f3cfa44fc tempest-AttachVolumeNegativeTest-355458312 None] Created volume successfully. Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0981499-b305-44c0-9769-7716ec347f96]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:44 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 Sep 01 01:07:44 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:44 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0" returned: 0 in 0.526s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:07:44 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f24e5-2c2d-4274-b32a-ce9e789c4ed3]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:44 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 Sep 01 01:07:44 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:45 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587" returned: 0 in 0.835s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:45 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 Sep 01 01:07:45 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-325779ed-0f41-4d4e-bb11-513fc1a76c47 req-587b76f8-bea3-4c49-815c-60da00d2a5f9 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-325779ed-0f41-4d4e-bb11-513fc1a76c47 req-587b76f8-bea3-4c49-815c-60da00d2a5f9 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-325779ed-0f41-4d4e-bb11-513fc1a76c47 req-587b76f8-bea3-4c49-815c-60da00d2a5f9 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-325779ed-0f41-4d4e-bb11-513fc1a76c47 req-587b76f8-bea3-4c49-815c-60da00d2a5f9 tempest-AttachVolumeNegativeTest-355458312 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df5b6b08-dda4-497e-8855-b8666ef7182b', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:07:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-325779ed-0f41-4d4e-bb11-513fc1a76c47 req-587b76f8-bea3-4c49-815c-60da00d2a5f9 tempest-AttachVolumeNegativeTest-355458312 None] attachment_update completed successfully. Sep 01 01:07:46 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0" returned: 0 in 0.752s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:46 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0 Sep 01 01:07:46 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:46 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587.eec05e4b-20b1-47c7-b7ad-09adcaee21a0" returned: 0 in 0.590s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-eec05e4b-20b1-47c7-b7ad-09adcaee21a0" released by "_delete_snapshot" :: held 2.891s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-9cbc4042-6c62-46da-bf8e-30d7e8afc587" released by "delete_snapshot" :: held 2.964s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:47 devstack cinder-volume[87064]: WARNING cinder.quota [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-676209718 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-676209718, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:07:47 devstack cinder-volume[87064]: WARNING cinder.quota [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-676209718 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-676209718, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:07:47 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] Created reservations ['3ed72c8a-db14-47ba-9cf3-ec416577b88b', '1dc95358-cef0-4ba6-9974-90a97f2fe6e5', '7e899d97-bba4-4a31-b8f4-d4581be99ccb', '8e17e996-373a-4fe9-8e37-666be39f1690'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:07:47 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-49ce2d51-8b2e-4b8c-88b6-91327b9bbb50 tempest-GroupSnapshotsTest-649271858 None] group_snapshot ea692d2d-07e2-48cc-9a3d-eda0b0590e9a: deleted successfully Sep 01 01:07:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "cinder-quobyte-9cbc4042-6c62-46da-bf8e-30d7e8afc587" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-9cbc4042-6c62-46da-bf8e-30d7e8afc587" acquired by "delete_volume" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:48 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac035a3-2afc-4afb-86ef-5a4cc3813ff8]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:48 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 Sep 01 01:07:48 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:48 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587" returned: 0 in 0.556s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:48 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587 Sep 01 01:07:48 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:48 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-f99ca85b-82b2-4867-9f3e-3eb5a7c21977 req-945f60de-d949-4666-919d-e83ae8619643 tempest-AttachVolumeNegativeTest-355458312 None] Terminate volume connection completed successfully. Sep 01 01:07:48 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-f99ca85b-82b2-4867-9f3e-3eb5a7c21977 req-945f60de-d949-4666-919d-e83ae8619643 tempest-AttachVolumeNegativeTest-355458312 None] Deleting attachment df5b6b08-dda4-497e-8855-b8666ef7182b. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:07:49 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9cbc4042-6c62-46da-bf8e-30d7e8afc587" returned: 0 in 0.394s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Lock "cinder-quobyte-9cbc4042-6c62-46da-bf8e-30d7e8afc587" released by "delete_volume" :: held 1.059s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Created reservations ['120a35fa-d9eb-45f7-ab52-afeac7720a5b'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:07:49 devstack cinder-volume[87064]: WARNING cinder.quota [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-676209718 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-676209718, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Created reservations ['f273be0a-c0e1-4ef5-8ac5-134b7f3b8b41', '0fcda0db-394b-4be5-8104-4a385c472126', 'af9708ee-8166-459d-b928-c88473d54d2b', '16972d2b-172c-42af-9e0b-d94d63dfa09b'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:49 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:07:49 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:49 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.360s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:49 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:07:49 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-bc2632ee-1acb-4da2-91f5-2fcef7042712 tempest-GroupSnapshotsTest-649271858 None] Delete group completed successfully. Sep 01 01:07:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:07:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:07:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:07:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:52 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:07:52 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:53 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.512s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:07:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:07:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 8 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:07:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:07:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "cinder-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "cinder-quobyte-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-quobyte-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a" acquired by "delete_volume" :: waited 0.057s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad716617-93ae-40ec-9d17-fddaa014f0c2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:55 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a Sep 01 01:07:55 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:56 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a" returned: 0 in 0.582s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:56 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a Sep 01 01:07:56 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:56 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a" returned: 0 in 0.401s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-quobyte-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a" released by "delete_volume" :: held 1.078s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=101,cinder:UPDATE=86,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Created reservations ['31068d1d-be47-4b4f-9fcc-4231e27b00f8', '6d90fb23-420d-4b70-b03f-e4d1de49c412', '98aa121a-910d-49ae-8eb1-c88adfe256c8', '897cb2dc-4241-46d3-9a46-e13648499e6b'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:56 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:07:56 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:57 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.279s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:57 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:07:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Deleted volume successfully. Sep 01 01:07:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f83171a6-8ef1-4b13-8bab-7db1108a4834 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-631a7ba2-3b1b-4c3a-98e6-2773d3a6e00a-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "cinder-fac093ba-1896-48d2-ad34-7a7ecf014337-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-fac093ba-1896-48d2-ad34-7a7ecf014337-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "cinder-quobyte-fac093ba-1896-48d2-ad34-7a7ecf014337" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-quobyte-fac093ba-1896-48d2-ad34-7a7ecf014337" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e220ef7-17a6-48cd-a73d-fed41ea72b1d]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:58 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337 Sep 01 01:07:58 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:58 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337" returned: 0 in 0.435s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:58 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337 Sep 01 01:07:58 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:58 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-fac093ba-1896-48d2-ad34-7a7ecf014337" returned: 0 in 0.300s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-quobyte-fac093ba-1896-48d2-ad34-7a7ecf014337" released by "delete_volume" :: held 0.784s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:58 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Created reservations ['69048791-3381-4dea-82b9-9dbe1ff5ae8d', '7314a49d-6408-4f5a-acfd-6677e34054e3', 'd60bcae4-14e8-43ae-85c5-04943b5bf3b2', '03b7b846-2bbd-4fa6-815c-9fda00037e52'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:59 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:07:59 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:07:59 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.575s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:07:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Deleted volume successfully. Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "cinder-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-647e8312-48d8-43e3-a2d3-a8b037042196 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-fac093ba-1896-48d2-ad34-7a7ecf014337-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "cinder-quobyte-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-quobyte-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[332f257c-4083-4a73-b9e8-039b0b86ec45]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:07:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:07:59 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8 Sep 01 01:07:59 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:00 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8" returned: 0 in 0.610s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:00 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8 Sep 01 01:08:00 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:00 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8" returned: 0 in 0.530s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-quobyte-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8" released by "delete_volume" :: held 1.187s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:08:01 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Created reservations ['09f3e067-bf0c-4937-8bf1-6e57d3cbc2f2', '245e71b9-9435-41f4-adda-a634268aced8', '2d0ee899-bb1a-4c6f-8452-9fca0319712c', '5e526bda-27e0-4ea0-b8d6-8b385ea217a3'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:08:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:01 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:08:01 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:01 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.307s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:01 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:08:01 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Deleted volume successfully. Sep 01 01:08:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90668f6d-d9b1-4ea8-9f57-bae3f6fdd494 tempest-AttachVolumeNegativeTest-355458312 None] Lock "cinder-3a6a0adc-8202-4148-a79d-fd13b9e2e0b8-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:08:11 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=27,cinder:SELECT=7,cinder:INSERT=4 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:08:11 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=96,cinder:INSERT=30,cinder:DELETE=5,cinder:SELECT=97 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Flow 'volume_create_manager' (aae3fdc1-ca9d-4184-8af8-a2e7f48cd35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775f6692-2b46-41db-83e4-5bf786250c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775f6692-2b46-41db-83e4-5bf786250c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1610380462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='336e9de2f9b94ceb8d598185c941fa6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:14Z,use_quota=True,user_id='fd259b26fd934d1abf2f659a3e073b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a7c231-95bc-46ca-a340-fea22e74125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a7c231-95bc-46ca-a340-fea22e74125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d9e76c-4f34-45e9-9e1f-96813aaa4eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d9e76c-4f34-45e9-9e1f-96813aaa4eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff', 'volume_name': 'volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a3a15e-d112-4236-a09e-e03c0443c592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a3a15e-d112-4236-a09e-e03c0443c592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9cabd2-dea9-4828-9d3e-f96f0b15c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:13 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Volume b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff', 'volume_size': 1} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1610380462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='336e9de2f9b94ceb8d598185c941fa6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:14Z,use_quota=True,user_id='fd259b26fd934d1abf2f659a3e073b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Creating volume b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:08:13 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:08:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:14 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff 1073741824 Sep 01 01:08:14 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:14 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff 1073741824" returned: 0 in 0.759s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:14 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff Sep 01 01:08:14 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:15 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff" returned: 0 in 0.606s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:08:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9cabd2-dea9-4828-9d3e-f96f0b15c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d072d62-7816-4642-8811-3256d273955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:15 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Volume volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff (b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff): created successfully Sep 01 01:08:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d072d62-7816-4642-8811-3256d273955a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Flow 'volume_create_manager' (aae3fdc1-ca9d-4184-8af8-a2e7f48cd35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-ad48a0f3-e31c-4d5f-a6b1-2dc047a97dda req-713323d7-2fa4-4859-9d4e-489cf263f57c tempest-VolumesGetTestJSON-1284544783 None] Created volume successfully. Sep 01 01:08:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Acquiring lock "cinder-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:08:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Lock "cinder-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:08:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Acquiring lock "cinder-quobyte-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:08:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Lock "cinder-quobyte-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:08:17 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0370bcd9-ddfa-4455-96c4-1c7314130f25]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:08:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:17 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff Sep 01 01:08:17 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:17 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff" returned: 0 in 0.533s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:17 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff Sep 01 01:08:17 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:17 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff" returned: 0 in 0.347s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Lock "cinder-quobyte-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff" released by "delete_volume" :: held 0.985s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:08:18 devstack cinder-volume[87064]: DEBUG cinder.quota [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Created reservations ['baa791ef-9568-4ce0-9490-f24052864c07', 'c93c3eca-6e7e-418a-86ad-3199ee635540', '14083487-6231-4fa1-8038-96bbcf1c7d7f', '78c980e7-7e24-4c65-bde7-dfb7447f6170'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:08:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:18 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:08:18 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:18 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.336s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:18 devstack cinder-volume[87064]: DEBUG cinder.manager [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:08:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Deleted volume successfully. Sep 01 01:08:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-0c5f97d4-3ebb-4cfa-8644-bdc5de4898c7 req-6d6a9005-1efb-4946-a99d-3c9d88e2cc7f tempest-VolumesGetTestJSON-1284544783 None] Lock "cinder-b387cf0a-e25b-4a0b-9cfe-42c70f9b5bff-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:08:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4cee157-94d1-46fe-8c55-8f982be93700 tempest-BackendsCapabilitiesAdminTestsJSON-573508442 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3822937011719, 'free_capacity_gb': 1774.3822937011719, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87064) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 01:08:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-23dddd87-2f84-4e2f-b8ea-9abd6dcc25d1 tempest-BackendsCapabilitiesAdminTestsJSON-573508442 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3822937011719, 'free_capacity_gb': 1774.3822937011719, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87064) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 01:08:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8397f2f8-78c1-488f-89dd-907e8b097bb7 req-71ace989-af5a-4db6-b76c-003bccb1f399 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8397f2f8-78c1-488f-89dd-907e8b097bb7 req-71ace989-af5a-4db6-b76c-003bccb1f399 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8397f2f8-78c1-488f-89dd-907e8b097bb7 req-71ace989-af5a-4db6-b76c-003bccb1f399 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-8397f2f8-78c1-488f-89dd-907e8b097bb7 req-71ace989-af5a-4db6-b76c-003bccb1f399 tempest-ServerActionsTestOtherA-2054217892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-a564fb07-53ed-433f-b998-69139e9469f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc56b682-558d-4f1a-9c5c-5bc352a80ffd', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:08:26 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-8397f2f8-78c1-488f-89dd-907e8b097bb7 req-71ace989-af5a-4db6-b76c-003bccb1f399 tempest-ServerActionsTestOtherA-2054217892 None] attachment_update completed successfully. Sep 01 01:08:30 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-33d8020c-1d48-4af4-aae9-ae4424841b10 req-c736b6e1-a3c3-4b65-9f3c-5da668a8e9af tempest-ServerActionsTestOtherA-2054217892 None] Terminate volume connection completed successfully. Sep 01 01:08:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-33d8020c-1d48-4af4-aae9-ae4424841b10 req-c736b6e1-a3c3-4b65-9f3c-5da668a8e9af tempest-ServerActionsTestOtherA-2054217892 None] Deleting attachment fc56b682-558d-4f1a-9c5c-5bc352a80ffd. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:08:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-33d8020c-1d48-4af4-aae9-ae4424841b10 req-c011a7cd-9f0d-440b-b700-b5495725d789 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-33d8020c-1d48-4af4-aae9-ae4424841b10 req-c011a7cd-9f0d-440b-b700-b5495725d789 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-33d8020c-1d48-4af4-aae9-ae4424841b10 req-c011a7cd-9f0d-440b-b700-b5495725d789 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-33d8020c-1d48-4af4-aae9-ae4424841b10 req-c011a7cd-9f0d-440b-b700-b5495725d789 tempest-ServerActionsTestOtherA-2054217892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-a564fb07-53ed-433f-b998-69139e9469f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5756c298-416b-494c-8f9d-2fd7675331f0', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:08:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-33d8020c-1d48-4af4-aae9-ae4424841b10 req-c011a7cd-9f0d-440b-b700-b5495725d789 tempest-ServerActionsTestOtherA-2054217892 None] attachment_update completed successfully. Sep 01 01:08:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-54bca190-a9d3-4386-99af-e2fc38a8ae91 tempest-GroupsV314Test-1022791468 None] Group tempest-GroupsV314Test-Group-494326234: creating Sep 01 01:08:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-54bca190-a9d3-4386-99af-e2fc38a8ae91 tempest-GroupsV314Test-1022791468 None] Group tempest-GroupsV314Test-Group-494326234: created successfully Sep 01 01:08:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-54bca190-a9d3-4386-99af-e2fc38a8ae91 tempest-GroupsV314Test-1022791468 None] Create group completed successfully. Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Flow 'volume_create_manager' (e58f3e68-82fd-4010-bf46-2851e37a8d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be908c01-34b5-4414-9393-184098d5d7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be908c01-34b5-4414-9393-184098d5d7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2083285097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b248f7d6-45f8-40b5-8d4e-d96f265668aa,host='devstack@QuobyteHD#QuobyteHD',id=2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f28b5fb3c642139f6c57590863f077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:37Z,use_quota=True,user_id='6e4f29e9aa8544aab8b3f244bfbf098f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a75969b-a1a5-4e37-93c5-544eac9d0dc3),volume_type_id=9a75969b-a1a5-4e37-93c5-544eac9d0dc3)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5176b1fe-355c-430b-a3de-7b0ff24c4793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5176b1fe-355c-430b-a3de-7b0ff24c4793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a513ac6a-df80-4441-839c-6c350f146c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a513ac6a-df80-4441-839c-6c350f146c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba', 'volume_name': 'volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799ac47f-69ee-40f3-aea6-b20ef21e1ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799ac47f-69ee-40f3-aea6-b20ef21e1ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895e5226-4aad-433d-a0f0-098e10ae3028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:36 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Volume 2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba', 'volume_size': 1} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b248f7d6-45f8-40b5-8d4e-d96f265668aa,created_at=2026-08-31T23:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2083285097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b248f7d6-45f8-40b5-8d4e-d96f265668aa,host='devstack@QuobyteHD#QuobyteHD',id=2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f28b5fb3c642139f6c57590863f077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:37Z,use_quota=True,user_id='6e4f29e9aa8544aab8b3f244bfbf098f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a75969b-a1a5-4e37-93c5-544eac9d0dc3),volume_type_id=9a75969b-a1a5-4e37-93c5-544eac9d0dc3)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Creating volume 2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:08:36 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:08:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:36 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba 1073741824 Sep 01 01:08:36 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:37 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba 1073741824" returned: 0 in 0.893s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:37 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba Sep 01 01:08:37 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:38 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba" returned: 0 in 0.451s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:08:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895e5226-4aad-433d-a0f0-098e10ae3028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedd6f2a-261f-4c1d-b654-5da3d1967d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:38 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Volume volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba (2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba): created successfully Sep 01 01:08:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedd6f2a-261f-4c1d-b654-5da3d1967d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Flow 'volume_create_manager' (e58f3e68-82fd-4010-bf46-2851e37a8d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:38 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b2fb2bf1-ac11-4463-9794-d43a4335a383 tempest-GroupsV314Test-1022791468 None] Created volume successfully. Sep 01 01:08:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:40 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Cloning volume 2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba to volume 05c9c7ec-3d47-4d22-b4b5-5e4db7a892da Sep 01 01:08:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Creating offline snapshot cfdb077b-4031-4658-a64b-be25069b4feb of volume 2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:08:40 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e56fa91-b306-479c-8d19-ee59ef49a9ed]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:08:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:40 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba Sep 01 01:08:40 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:40 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba" returned: 0 in 0.577s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:40 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb 1G Sep 01 01:08:40 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:41 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb 1G" returned: 0 in 0.500s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:41 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb Sep 01 01:08:41 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:41 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb" returned: 0 in 0.398s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:41 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:08:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:41 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb Sep 01 01:08:41 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:42 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb" returned: 0 in 0.363s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:42 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.info Sep 01 01:08:42 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:42 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.info" returned: 0 in 0.374s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:42 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:08:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:42 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.info Sep 01 01:08:42 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:43 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.info" returned: 0 in 0.381s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Acquiring lock "cinder-quobyte-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Lock "cinder-quobyte-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] snapshot: cfdb077b-4031-4658-a64b-be25069b4feb, volume: 05c9c7ec-3d47-4d22-b4b5-5e4db7a892da, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d4ac2c-0993-47e2-bb66-9592d1abd197]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Flow 'volume_create_manager' (f6c5b263-547f-45cd-a1c8-888496a0dfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d83361-9cfa-4a17-b1d4-6079ae5bec3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d83361-9cfa-4a17-b1d4-6079ae5bec3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1654845526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cafbf180-713c-4493-9f03-ca0e08daaacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e16662350754443b690e77877437ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:43Z,use_quota=True,user_id='7abc31e384944f6da86059422e85462d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9282832c-db7d-4788-b044-5e51adbc2517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9282832c-db7d-4788-b044-5e51adbc2517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf806023-b934-4c74-938a-8c9f628a6546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf806023-b934-4c74-938a-8c9f628a6546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cafbf180-713c-4493-9f03-ca0e08daaacc', 'volume_name': 'volume-cafbf180-713c-4493-9f03-ca0e08daaacc', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:43 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb Sep 01 01:08:43 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77ad839-f56a-4bcc-8253-5f34bb39e336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77ad839-f56a-4bcc-8253-5f34bb39e336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a65a05-e322-41df-9343-6b59952da710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:43 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Volume cafbf180-713c-4493-9f03-ca0e08daaacc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cafbf180-713c-4493-9f03-ca0e08daaacc', 'volume_size': 1} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:43 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb" returned: 0 in 0.541s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3ab969-bc6d-4fcc-822c-21737cd87ba1]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:08:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:43 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba Sep 01 01:08:43 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:44 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba" returned: 0 in 0.548s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:44 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da Sep 01 01:08:44 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Flow 'volume_create_manager' (85fe8b33-dba9-4ba8-b4a6-f48042c137b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cafc632-24d6-48f5-b053-083ce26abf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cafc632-24d6-48f5-b053-083ce26abf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1921653706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23d603a-8223-4f6b-8d67-5f5490506ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea6e64baa8445d58c6c9e9311200b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:44Z,use_quota=True,user_id='fd933281e9624f96b4e4928ae4436f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b00916-d0f6-4fa1-99a3-9ee793d45d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b00916-d0f6-4fa1-99a3-9ee793d45d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd2501e-3f46-4100-a0f5-e5e28af04665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd2501e-3f46-4100-a0f5-e5e28af04665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd23d603a-8223-4f6b-8d67-5f5490506ce5', 'volume_name': 'volume-d23d603a-8223-4f6b-8d67-5f5490506ce5', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2612d884-4be1-4ac3-a2e6-ae221fb49278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2612d884-4be1-4ac3-a2e6-ae221fb49278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6cad1c9-6327-4f64-acdd-680a5302e865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:44 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Volume d23d603a-8223-4f6b-8d67-5f5490506ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d23d603a-8223-4f6b-8d67-5f5490506ce5', 'volume_size': 1} Sep 01 01:08:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:49 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da" returned: 0 in 5.642s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:49 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:08:49 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Converted 1024.00 MB image at 181.46 MB/s Sep 01 01:08:49 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:08:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:49 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da Sep 01 01:08:49 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:50 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da" returned: 0 in 0.293s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Lock "cinder-quobyte-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da" released by "_copy_volume_from_snapshot" :: held 7.157s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Acquiring lock "cinder-quobyte-cfdb077b-4031-4658-a64b-be25069b4feb" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Lock "cinder-quobyte-cfdb077b-4031-4658-a64b-be25069b4feb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Deleting offline snapshot cfdb077b-4031-4658-a64b-be25069b4feb of volume 2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] snapshot_file for this snap is: volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a60f8a-9d3b-4623-a0a1-bf53cc0901ee]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:50 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb Sep 01 01:08:50 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:50 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb" returned: 0 in 0.370s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8815af69-c5ec-4fb6-a630-1a1c3973353c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:08:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:50 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba Sep 01 01:08:50 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:51 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba" returned: 0 in 0.538s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:51 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb Sep 01 01:08:51 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:51 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb" returned: 0 in 0.333s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:51 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb Sep 01 01:08:51 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:51 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba.cfdb077b-4031-4658-a64b-be25069b4feb" returned: 0 in 0.240s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Lock "cinder-quobyte-cfdb077b-4031-4658-a64b-be25069b4feb" released by "_delete_snapshot" :: held 1.572s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.634s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.453s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1654845526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cafbf180-713c-4493-9f03-ca0e08daaacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e16662350754443b690e77877437ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:43Z,use_quota=True,user_id='7abc31e384944f6da86059422e85462d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Creating volume cafbf180-713c-4493-9f03-ca0e08daaacc {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:08:51 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:08:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:51 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc 1073741824 Sep 01 01:08:51 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:52 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-1379bdbd-5afb-4401-9b22-029c2605dfef tempest-GroupsV314Test-1022791468 None] Create group from source-group-b248f7d6-45f8-40b5-8d4e-d96f265668aa completed successfully. Sep 01 01:08:52 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc 1073741824" returned: 0 in 0.601s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:52 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc Sep 01 01:08:52 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:52 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:08:52 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:52 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc" returned: 0 in 0.292s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.224s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1921653706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23d603a-8223-4f6b-8d67-5f5490506ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea6e64baa8445d58c6c9e9311200b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:44Z,use_quota=True,user_id='fd933281e9624f96b4e4928ae4436f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Creating volume d23d603a-8223-4f6b-8d67-5f5490506ce5 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:08:52 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Acquiring lock "cinder-quobyte-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:08:52 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5 1073741824 Sep 01 01:08:52 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a65a05-e322-41df-9343-6b59952da710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cafbf180-713c-4493-9f03-ca0e08daaacc', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0838115-a916-4cbc-9ab7-a1af41662b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Lock "cinder-quobyte-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da" acquired by "delete_volume" :: waited 0.051s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:08:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Volume volume-cafbf180-713c-4493-9f03-ca0e08daaacc (cafbf180-713c-4493-9f03-ca0e08daaacc): created successfully Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0838115-a916-4cbc-9ab7-a1af41662b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Flow 'volume_create_manager' (f6c5b263-547f-45cd-a1c8-888496a0dfd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4c1fab-5ae6-4a94-8f30-31f5a6124b45]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:08:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:52 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0237da71-bad6-4486-a2ee-a6c3b4ad75c1 tempest-AttachVolumeTestJSON-123863135 None] Created volume successfully. Sep 01 01:08:53 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.303s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 8 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:08:53 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da Sep 01 01:08:53 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:53 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da" returned: 0 in 0.443s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:53 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da Sep 01 01:08:53 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:53 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5 1073741824" returned: 0 in 0.604s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:53 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5 Sep 01 01:08:53 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:53 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da" returned: 0 in 0.329s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Lock "cinder-quobyte-05c9c7ec-3d47-4d22-b4b5-5e4db7a892da" released by "delete_volume" :: held 0.840s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:08:53 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5" returned: 0 in 0.306s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6cad1c9-6327-4f64-acdd-680a5302e865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d23d603a-8223-4f6b-8d67-5f5490506ce5', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b331b748-8297-428b-9c8f-feeed4571bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Created reservations ['60138188-c14c-482c-950d-6fecbfbf8f99'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:08:53 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Volume volume-d23d603a-8223-4f6b-8d67-5f5490506ce5 (d23d603a-8223-4f6b-8d67-5f5490506ce5): created successfully Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b331b748-8297-428b-9c8f-feeed4571bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Flow 'volume_create_manager' (85fe8b33-dba9-4ba8-b4a6-f48042c137b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:53 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-32804236-7a1b-44e1-b22a-14c6b42d558c tempest-VolumeQuotasAdminTestJSON-301772026 None] Created volume successfully. Sep 01 01:08:53 devstack cinder-volume[87064]: WARNING cinder.quota [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1806796116 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1806796116, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:08:53 devstack cinder-volume[87064]: WARNING cinder.quota [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1806796116 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1806796116, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:08:53 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Created reservations ['7e3c2484-5896-4615-9f1b-ddcf8cf1b960', 'aac8aef8-9c83-42c7-addf-c0d6c614d224', '888f8346-b3a1-48f8-b83f-085bea06400c', '60babe77-a8c6-4452-8d1f-d16049d78e8b'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:54 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:08:54 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ea1e4100-44f7-4713-9db3-da173f03ea19 req-a0b5aab0-86b5-4abf-b6e3-1f07827a7929 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ea1e4100-44f7-4713-9db3-da173f03ea19 req-a0b5aab0-86b5-4abf-b6e3-1f07827a7929 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ea1e4100-44f7-4713-9db3-da173f03ea19 req-a0b5aab0-86b5-4abf-b6e3-1f07827a7929 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ea1e4100-44f7-4713-9db3-da173f03ea19 req-a0b5aab0-86b5-4abf-b6e3-1f07827a7929 tempest-AttachVolumeTestJSON-123863135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-cafbf180-713c-4493-9f03-ca0e08daaacc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7cf38cc2-5437-47f2-ac58-e056c1230c54', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:08:54 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.284s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:08:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-ea1e4100-44f7-4713-9db3-da173f03ea19 req-a0b5aab0-86b5-4abf-b6e3-1f07827a7929 tempest-AttachVolumeTestJSON-123863135 None] attachment_update completed successfully. Sep 01 01:08:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a83f3515-9554-4074-9c37-477d862a49d0 tempest-GroupsV314Test-1022791468 None] Delete group completed successfully. Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Acquiring lock "cinder-d23d603a-8223-4f6b-8d67-5f5490506ce5-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "cinder-d23d603a-8223-4f6b-8d67-5f5490506ce5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Acquiring lock "cinder-quobyte-d23d603a-8223-4f6b-8d67-5f5490506ce5" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "cinder-quobyte-d23d603a-8223-4f6b-8d67-5f5490506ce5" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[42875153-a389-4816-9ebd-b23c447a4306]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:08:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:54 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5 Sep 01 01:08:54 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:55 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5" returned: 0 in 0.448s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:55 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5 Sep 01 01:08:55 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Acquiring lock "cinder-quobyte-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Lock "cinder-quobyte-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:08:55 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d23d603a-8223-4f6b-8d67-5f5490506ce5" returned: 0 in 0.408s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6df36f-d940-42d9-a7bf-b7d8b3505083]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "cinder-quobyte-d23d603a-8223-4f6b-8d67-5f5490506ce5" released by "delete_volume" :: held 0.922s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Created reservations ['fc512bd1-e2cc-4afb-90b3-c4cbf05ad26d', '26d9d351-3f4b-4bd3-bdb9-dba2a4910c7a', '5758d017-103d-421b-8388-2dae2d2fe16a', 'ceefd0cc-746b-4246-bcbc-db95f722bcca'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:08:55 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba Sep 01 01:08:55 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:55 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:08:55 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:55 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.302s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:55 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:08:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Deleted volume successfully. Sep 01 01:08:56 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba" returned: 0 in 0.505s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4de1147e-5e5a-4662-ade3-5c67c437c201 tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "cinder-d23d603a-8223-4f6b-8d67-5f5490506ce5-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:08:56 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba Sep 01 01:08:56 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Flow 'volume_create_manager' (6edeea41-0bdb-467f-ba69-6f87db63c7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e09a960-2ee7-4aa3-b960-f9c76d47c548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e09a960-2ee7-4aa3-b960-f9c76d47c548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-703101267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408bcec3-06fe-43ee-b85d-f2a71d9fe753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e16662350754443b690e77877437ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:56Z,use_quota=True,user_id='7abc31e384944f6da86059422e85462d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d73adc6-f599-43af-a115-0865798c63c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d73adc6-f599-43af-a115-0865798c63c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a1b0a9-2cdc-4f22-bdd1-5a1deaa29ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a1b0a9-2cdc-4f22-bdd1-5a1deaa29ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408bcec3-06fe-43ee-b85d-f2a71d9fe753', 'volume_name': 'volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884de5f1-53a9-4846-b665-8e23a322677b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884de5f1-53a9-4846-b665-8e23a322677b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3281f64-acd4-4dac-894e-7f0b13f19cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:56 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Volume 408bcec3-06fe-43ee-b85d-f2a71d9fe753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753', 'volume_size': 1} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-703101267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408bcec3-06fe-43ee-b85d-f2a71d9fe753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e16662350754443b690e77877437ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:56Z,use_quota=True,user_id='7abc31e384944f6da86059422e85462d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Creating volume 408bcec3-06fe-43ee-b85d-f2a71d9fe753 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:08:56 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:56 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753 1073741824 Sep 01 01:08:56 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:56 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba" returned: 0 in 0.333s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Lock "cinder-quobyte-2ef4f7cc-0ba9-4d42-8bf4-3e6c520d6bba" released by "delete_volume" :: held 0.908s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Created reservations ['3bdb4498-f93d-42ef-b21a-65864ba2e049'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Flow 'volume_create_manager' (112d61db-725d-48d4-9f3e-74b1b6b8c9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd636c1f-74e1-4a85-9a7c-c95aa2dbf5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd636c1f-74e1-4a85-9a7c-c95aa2dbf5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-83695023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141da503-94b6-47c7-9704-3c85c1eb3464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea6e64baa8445d58c6c9e9311200b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:56Z,use_quota=True,user_id='fd933281e9624f96b4e4928ae4436f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191fd92d-43c2-4268-9df7-fd400bf5dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191fd92d-43c2-4268-9df7-fd400bf5dda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8543c1ca-9af0-4e41-adac-d2c0a1c93562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8543c1ca-9af0-4e41-adac-d2c0a1c93562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141da503-94b6-47c7-9704-3c85c1eb3464', 'volume_name': 'volume-141da503-94b6-47c7-9704-3c85c1eb3464', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3c0be6-98d9-4717-9b04-33195328dd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3c0be6-98d9-4717-9b04-33195328dd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c3fb2a-1049-4ea0-8be7-4c493333251d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:56 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Volume 141da503-94b6-47c7-9704-3c85c1eb3464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141da503-94b6-47c7-9704-3c85c1eb3464', 'volume_size': 1} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Created reservations ['9885ac2d-11af-47a4-8303-ef9f64c19b67', '353c5a34-85d0-4176-8328-75821919fb67', '7f7d409e-a29a-4730-b728-0f794b24a1d5', '31e8e977-8b2c-4ad7-bcc5-f4621f908981'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:08:56 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753 1073741824" returned: 0 in 0.529s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:56 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:08:56 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:56 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753 Sep 01 01:08:56 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:57 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.295s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:08:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-97cd6725-e4b8-4abe-9ef8-3a08b78e626d tempest-GroupsV314Test-1022791468 None] Delete group completed successfully. Sep 01 01:08:57 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753" returned: 0 in 0.290s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-83695023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141da503-94b6-47c7-9704-3c85c1eb3464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea6e64baa8445d58c6c9e9311200b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:08:56Z,use_quota=True,user_id='fd933281e9624f96b4e4928ae4436f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Creating volume 141da503-94b6-47c7-9704-3c85c1eb3464 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:08:57 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3281f64-acd4-4dac-894e-7f0b13f19cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:57 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464 1073741824 Sep 01 01:08:57 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d87316-113b-49e2-81e8-8839217b3e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:57 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Volume volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753 (408bcec3-06fe-43ee-b85d-f2a71d9fe753): created successfully Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d87316-113b-49e2-81e8-8839217b3e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Flow 'volume_create_manager' (6edeea41-0bdb-467f-ba69-6f87db63c7a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6b1c06c2-002a-4ed8-88dd-c97fda067540 tempest-AttachVolumeTestJSON-123863135 None] Created volume successfully. Sep 01 01:08:57 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464 1073741824" returned: 0 in 0.550s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:08:57 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464 Sep 01 01:08:57 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:08:57 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464" returned: 0 in 0.292s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c3fb2a-1049-4ea0-8be7-4c493333251d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141da503-94b6-47c7-9704-3c85c1eb3464', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dffc8d-55dd-4d58-8632-e5daf51d0734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:08:58 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Volume volume-141da503-94b6-47c7-9704-3c85c1eb3464 (141da503-94b6-47c7-9704-3c85c1eb3464): created successfully Sep 01 01:08:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dffc8d-55dd-4d58-8632-e5daf51d0734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:08:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Flow 'volume_create_manager' (112d61db-725d-48d4-9f3e-74b1b6b8c9b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:08:58 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2a3ec5e7-fd6e-42c9-833b-fd22ac41ac6c tempest-VolumeQuotasAdminTestJSON-301772026 None] Created volume successfully. Sep 01 01:08:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8453d3f9-936a-45e0-9fa1-ec0f9887d6cb req-1e851fb1-cdeb-407a-9353-1267301c1a00 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:08:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8453d3f9-936a-45e0-9fa1-ec0f9887d6cb req-1e851fb1-cdeb-407a-9353-1267301c1a00 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:08:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8453d3f9-936a-45e0-9fa1-ec0f9887d6cb req-1e851fb1-cdeb-407a-9353-1267301c1a00 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:08:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-8453d3f9-936a-45e0-9fa1-ec0f9887d6cb req-1e851fb1-cdeb-407a-9353-1267301c1a00 tempest-AttachVolumeTestJSON-123863135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fc861d0-13d1-4ab4-a9ed-fa1038ea72ae', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:08:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-87c7f119-922c-412e-8f95-bfb98e844d39 tempest-VolumeQuotasAdminTestJSON-1012390732 None] Transfer volume completed successfully. Sep 01 01:08:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-8453d3f9-936a-45e0-9fa1-ec0f9887d6cb req-1e851fb1-cdeb-407a-9353-1267301c1a00 tempest-AttachVolumeTestJSON-123863135 None] attachment_update completed successfully. Sep 01 01:09:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Acquiring lock "cinder-141da503-94b6-47c7-9704-3c85c1eb3464-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Lock "cinder-141da503-94b6-47c7-9704-3c85c1eb3464-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Acquiring lock "cinder-quobyte-141da503-94b6-47c7-9704-3c85c1eb3464" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Lock "cinder-quobyte-141da503-94b6-47c7-9704-3c85c1eb3464" acquired by "delete_volume" :: waited 0.042s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fd29b4-ff69-410f-a183-6eb2ceb66ae0]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:00 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464 Sep 01 01:09:00 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:01 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464" returned: 0 in 0.487s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:01 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464 Sep 01 01:09:01 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:01 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-141da503-94b6-47c7-9704-3c85c1eb3464" returned: 0 in 0.355s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Lock "cinder-quobyte-141da503-94b6-47c7-9704-3c85c1eb3464" released by "delete_volume" :: held 0.934s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:01 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Created reservations ['b9fcf06c-e990-49c8-8a88-71e0c25b6c72', '9f41f958-8e1a-4fe5-bc99-8461de68ff5a', 'b97a5ffe-efd6-485c-86f6-2041606d805f', 'd0ed9f5b-4812-4178-b7f7-7afdea10ee77'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:09:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:01 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:09:01 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:02 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.367s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:02 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:09:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Deleted volume successfully. Sep 01 01:09:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-77a5c67e-35c2-4872-990e-6d4413cfa404 req-4617d54f-47c0-4329-83bc-47e15786213b tempest-ServerActionsTestOtherA-2054217892 None] Terminate volume connection completed successfully. Sep 01 01:09:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-77a5c67e-35c2-4872-990e-6d4413cfa404 req-4617d54f-47c0-4329-83bc-47e15786213b tempest-ServerActionsTestOtherA-2054217892 None] Deleting attachment 5756c298-416b-494c-8f9d-2fd7675331f0. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:09:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fdd810f4-bcf5-4a57-8322-5c495995d137 tempest-VolumeQuotasAdminTestJSON-737039110 None] Lock "cinder-141da503-94b6-47c7-9704-3c85c1eb3464-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-d24687d2-8ca1-4850-b7a8-f6a57509e2ac req-bd165f96-6a7e-4570-b454-3f543e8b9184 tempest-AttachVolumeTestJSON-123863135 None] Terminate volume connection completed successfully. Sep 01 01:09:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-d24687d2-8ca1-4850-b7a8-f6a57509e2ac req-bd165f96-6a7e-4570-b454-3f543e8b9184 tempest-AttachVolumeTestJSON-123863135 None] Deleting attachment 7cf38cc2-5437-47f2-ac58-e056c1230c54. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:09:04 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-15130a96-f570-44ff-bc8d-ae9468e67ecf req-1a0c1f34-1036-49ad-9098-bf0a5ee9928a tempest-AttachVolumeTestJSON-123863135 None] Terminate volume connection completed successfully. Sep 01 01:09:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-15130a96-f570-44ff-bc8d-ae9468e67ecf req-1a0c1f34-1036-49ad-9098-bf0a5ee9928a tempest-AttachVolumeTestJSON-123863135 None] Deleting attachment 8fc861d0-13d1-4ab4-a9ed-fa1038ea72ae. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Flow 'volume_create_manager' (a284f093-73ac-4ede-9b0b-8c99eca53eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c6aa57-0ba8-4216-b1a2-011724467591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c6aa57-0ba8-4216-b1a2-011724467591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1132053248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28dde1bf-c403-4167-a628-fe8172b93f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494872cb03544ff68c6d0607f436b2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:06Z,use_quota=True,user_id='06d7face91c748ee875662c5bb7a25aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809a0876-78ad-4f30-b8e8-243bc838457a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809a0876-78ad-4f30-b8e8-243bc838457a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddc2a24-8aef-41d9-8716-e0d8e295bf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddc2a24-8aef-41d9-8716-e0d8e295bf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28dde1bf-c403-4167-a628-fe8172b93f0c', 'volume_name': 'volume-28dde1bf-c403-4167-a628-fe8172b93f0c', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cccd87-ea01-43d0-b2e9-6f457dd1e542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cccd87-ea01-43d0-b2e9-6f457dd1e542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f369d9e2-039f-42e9-8d90-0d99a14cd7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:05 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Volume 28dde1bf-c403-4167-a628-fe8172b93f0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28dde1bf-c403-4167-a628-fe8172b93f0c', 'volume_size': 1} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1132053248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28dde1bf-c403-4167-a628-fe8172b93f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494872cb03544ff68c6d0607f436b2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:06Z,use_quota=True,user_id='06d7face91c748ee875662c5bb7a25aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Creating volume 28dde1bf-c403-4167-a628-fe8172b93f0c {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:09:05 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:09:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:06 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c 1073741824 Sep 01 01:09:06 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:06 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c 1073741824" returned: 0 in 0.882s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:07 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c Sep 01 01:09:07 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:07 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c" returned: 0 in 0.411s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:07 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:09:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f369d9e2-039f-42e9-8d90-0d99a14cd7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28dde1bf-c403-4167-a628-fe8172b93f0c', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd4fc54-6911-47f5-b923-ef4f8e2e1ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:07 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Volume volume-28dde1bf-c403-4167-a628-fe8172b93f0c (28dde1bf-c403-4167-a628-fe8172b93f0c): created successfully Sep 01 01:09:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd4fc54-6911-47f5-b923-ef4f8e2e1ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Flow 'volume_create_manager' (a284f093-73ac-4ede-9b0b-8c99eca53eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:07 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-747dc57e-4358-4efe-aab4-09b65149a06b tempest-VolumeQuotasNegativeTestJSON-393002394 None] Created volume successfully. Sep 01 01:09:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Acquiring lock "cinder-28dde1bf-c403-4167-a628-fe8172b93f0c-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Lock "cinder-28dde1bf-c403-4167-a628-fe8172b93f0c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Acquiring lock "cinder-quobyte-28dde1bf-c403-4167-a628-fe8172b93f0c" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Lock "cinder-quobyte-28dde1bf-c403-4167-a628-fe8172b93f0c" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:09 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[003f0323-f177-4aa0-92db-1a8862c10cf2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:10 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c Sep 01 01:09:10 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:10 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c" returned: 0 in 0.631s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:10 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c Sep 01 01:09:10 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:10 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-28dde1bf-c403-4167-a628-fe8172b93f0c" returned: 0 in 0.482s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Lock "cinder-quobyte-28dde1bf-c403-4167-a628-fe8172b93f0c" released by "delete_volume" :: held 1.193s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Created reservations ['a42238b1-42ce-4f26-ace6-a8e3d927888a', '95dd0054-57a6-48bb-a770-8467a984aeb7', '1f1883db-6345-4be8-9078-e76325b51532', 'f8d75e3d-ab55-4273-8acb-77f39f81b4cc'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=88,cinder:SELECT=80,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:11 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:09:11 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "cinder-408bcec3-06fe-43ee-b85d-f2a71d9fe753-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-408bcec3-06fe-43ee-b85d-f2a71d9fe753-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "cinder-quobyte-408bcec3-06fe-43ee-b85d-f2a71d9fe753" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-quobyte-408bcec3-06fe-43ee-b85d-f2a71d9fe753" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:11 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.363s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:09:11 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Deleted volume successfully. Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=99,cinder:INSERT=15,cinder:UPDATE=83,cinder:DELETE=8 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ff3ef2-2ea9-4e98-a3b7-0ac8b6b20a47]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-def3706a-4eff-41e9-9e42-c5ae8896a40f tempest-VolumeQuotasNegativeTestJSON-393002394 None] Lock "cinder-28dde1bf-c403-4167-a628-fe8172b93f0c-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:11 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753 Sep 01 01:09:11 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:12 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753" returned: 0 in 0.651s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:12 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753 Sep 01 01:09:12 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Flow 'volume_create_manager' (16985e44-ba29-45eb-96a6-afd68410026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730fd5c0-e6c9-4128-beab-51e14b7c2e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730fd5c0-e6c9-4128-beab-51e14b7c2e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-65867178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea7772d-7e64-4d4a-a10f-38d2c3dae015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173192acc1cc4a2197c91b6f7939854c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:12Z,use_quota=True,user_id='61ad5c970c4e4dcbaefa3dbcd4d1da75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffe6e76-7853-47a7-b9af-8e64002a1adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffe6e76-7853-47a7-b9af-8e64002a1adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab4d343-e109-4e19-8b2b-938f4104eb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.image.glance [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Creating Keystone auth plugin from conf {{(pid=87064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:09:12 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-408bcec3-06fe-43ee-b85d-f2a71d9fe753" returned: 0 in 0.390s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-quobyte-408bcec3-06fe-43ee-b85d-f2a71d9fe753" released by "delete_volume" :: held 1.119s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Created reservations ['01c53566-0ab6-4445-bc5c-4997685fa98f', 'fec65b89-e83c-4503-a591-a6875db9b128', 'c2ba7f04-2438-4f63-bfd2-4f6508c90aa6', 'fbfdd29c-9bb3-4141-82d0-11a2685ee6f3'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:12 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:09:12 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:13 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.280s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:13 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:09:13 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Deleted volume successfully. Sep 01 01:09:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-83fbc139-4ae8-4d62-a230-63b7d76522f9 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-408bcec3-06fe-43ee-b85d-f2a71d9fe753-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "cinder-cafbf180-713c-4493-9f03-ca0e08daaacc-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-cafbf180-713c-4493-9f03-ca0e08daaacc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "cinder-quobyte-cafbf180-713c-4493-9f03-ca0e08daaacc" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-quobyte-cafbf180-713c-4493-9f03-ca0e08daaacc" acquired by "delete_volume" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e346b0-eec6-4aa3-9ea5-830900562db3]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab4d343-e109-4e19-8b2b-938f4104eb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ea7772d-7e64-4d4a-a10f-38d2c3dae015', 'volume_name': 'volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fa06b3-cbea-4b76-b1e5-afe62f529aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fa06b3-cbea-4b76-b1e5-afe62f529aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c10d6c-9708-410c-b442-c658e1ca95bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:14 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Volume 7ea7772d-7e64-4d4a-a10f-38d2c3dae015: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Trying to clone 7ea7772d-7e64-4d4a-a10f-38d2c3dae015 from image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]). {{(pid=87064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:09:14 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc Sep 01 01:09:14 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:14 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc" returned: 0 in 0.597s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:09:14 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Image download 20.69 MB at 20.69 MB/s Sep 01 01:09:14 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc Sep 01 01:09:14 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da6df8f-9edc-4c70-9df9-ef56bca3bf5f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:15 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD Sep 01 01:09:15 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:15 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cafbf180-713c-4493-9f03-ca0e08daaacc" returned: 0 in 0.364s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-quobyte-cafbf180-713c-4493-9f03-ca0e08daaacc" released by "delete_volume" :: held 1.058s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Created reservations ['f049ff7f-7006-4313-b402-14b4c2759573', '48bd48d2-02c8-405f-baa5-a79808b49f62', 'cd1e80ab-a0ad-443d-8c98-128b002d5616', '914ba0aa-70ae-4c00-bf3c-ddda0b56afcf'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:09:15 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Temporary image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 is fetched for user 61ad5c970c4e4dcbaefa3dbcd4d1da75. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:15 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:09:15 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d98157-be64-47cd-aa36-502b750f976e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:15 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD Sep 01 01:09:15 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:15 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.353s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:09:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Deleted volume successfully. Sep 01 01:09:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aae2c370-2373-4f91-927a-c62b6bf1eff3 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-cafbf180-713c-4493-9f03-ca0e08daaacc-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:16 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-65867178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea7772d-7e64-4d4a-a10f-38d2c3dae015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173192acc1cc4a2197c91b6f7939854c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:12Z,use_quota=True,user_id='61ad5c970c4e4dcbaefa3dbcd4d1da75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Creating volume 7ea7772d-7e64-4d4a-a10f-38d2c3dae015 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:09:16 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:16 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 1073741824 Sep 01 01:09:16 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "cinder-7b48f387-c08a-488d-9eb1-503912794605-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-7b48f387-c08a-488d-9eb1-503912794605-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "cinder-quobyte-7b48f387-c08a-488d-9eb1-503912794605" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-quobyte-7b48f387-c08a-488d-9eb1-503912794605" acquired by "delete_volume" :: waited 0.031s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5753c510-c064-48d9-89ea-d6908737c2a9]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:16 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 1073741824" returned: 0 in 0.732s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:16 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605 Sep 01 01:09:16 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:16 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 Sep 01 01:09:16 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Flow 'volume_create_manager' (f0e124c3-dd49-4236-b3d1-a1f44bc280b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7eb18f-7c87-4acc-9eee-c8f88dcaab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7eb18f-7c87-4acc-9eee-c8f88dcaab42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-790280909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385b651a-df08-446a-9ffc-ac117e378ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8518dbbf1f2b44b184492fc92a90666d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:17Z,use_quota=True,user_id='ecc091fba2bd458d92d2d0702f8bfa69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8956181e-9f52-4661-a44e-1b0cb55ad024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8956181e-9f52-4661-a44e-1b0cb55ad024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:16 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dc3b58-dd10-44a3-81da-afb356446231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dc3b58-dd10-44a3-81da-afb356446231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '385b651a-df08-446a-9ffc-ac117e378ffa', 'volume_name': 'volume-385b651a-df08-446a-9ffc-ac117e378ffa', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625f86c8-83b9-47a9-849c-470225999411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625f86c8-83b9-47a9-849c-470225999411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53154d1a-8cd3-4221-9619-358c97c3e6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:17 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Volume 385b651a-df08-446a-9ffc-ac117e378ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-385b651a-df08-446a-9ffc-ac117e378ffa', 'volume_size': 1} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:17 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015" returned: 0 in 0.353s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.124s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-790280909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385b651a-df08-446a-9ffc-ac117e378ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8518dbbf1f2b44b184492fc92a90666d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:17Z,use_quota=True,user_id='ecc091fba2bd458d92d2d0702f8bfa69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Creating volume 385b651a-df08-446a-9ffc-ac117e378ffa {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:09:17 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:17 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa 1073741824 Sep 01 01:09:17 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Attempting download of 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}])) to volume 7ea7772d-7e64-4d4a-a10f-38d2c3dae015. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:09:17 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605" returned: 0 in 0.578s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:17 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605 Sep 01 01:09:17 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a10df57-ac26-4b22-adbb-6ffccc6073ef]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_pjqezvsu {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:17 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_pjqezvsu Sep 01 01:09:17 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:17 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7b48f387-c08a-488d-9eb1-503912794605" returned: 0 in 0.347s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-quobyte-7b48f387-c08a-488d-9eb1-503912794605" released by "delete_volume" :: held 0.991s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Created reservations ['8c316a9b-d0ec-4eb4-ac0d-384d283f57f4', 'b0edb660-ae39-4b6e-885e-bfe037517c93', '4f696e89-2f30-4e23-a4b7-2c1c05a8f9d2', '99d36abf-0376-41a5-b50b-79636d76d704'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:09:17 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_pjqezvsu" returned: 0 in 0.492s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_pjqezvsu {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:17 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa 1073741824" returned: 0 in 0.787s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:17 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:09:17 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:18 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_pjqezvsu Sep 01 01:09:18 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:18 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa Sep 01 01:09:18 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:18 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.418s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:09:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Deleted volume successfully. Sep 01 01:09:18 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_pjqezvsu" returned: 1 in 0.594s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_pjqezvsu' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e0e703d-e0f7-4c17-93b9-4927f8145fa2 tempest-AttachVolumeTestJSON-123863135 None] Lock "cinder-7b48f387-c08a-488d-9eb1-503912794605-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77d0301-0fd7-4d3f-abb1-11205796a8d8]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:18 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa" returned: 0 in 0.416s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53154d1a-8cd3-4221-9619-358c97c3e6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385b651a-df08-446a-9ffc-ac117e378ffa', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0807c1-68af-4b9f-9887-8a0c1e4d34ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:18 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Volume volume-385b651a-df08-446a-9ffc-ac117e378ffa (385b651a-df08-446a-9ffc-ac117e378ffa): created successfully Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0807c1-68af-4b9f-9887-8a0c1e4d34ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Flow 'volume_create_manager' (f0e124c3-dd49-4236-b3d1-a1f44bc280b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-27ba0226-bbbc-4db9-872f-4b6d7ab800a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Created volume successfully. Sep 01 01:09:18 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD Sep 01 01:09:18 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:18 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 was qcow2, converting to qcow2 {{(pid=87064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:09:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:18 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 Sep 01 01:09:18 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Creating offline snapshot 1c735de8-43f6-4b32-966b-8ee4f838b51f of volume 385b651a-df08-446a-9ffc-ac117e378ffa {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:09:19 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ac858a-116a-4e65-ba34-0c4f7947109d]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:19 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa Sep 01 01:09:19 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:19 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa" returned: 0 in 0.496s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:19 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f 1G Sep 01 01:09:19 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:20 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f 1G" returned: 0 in 0.750s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-385b651a-df08-446a-9ffc-ac117e378ffa -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:20 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-385b651a-df08-446a-9ffc-ac117e378ffa -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f Sep 01 01:09:20 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:21 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-385b651a-df08-446a-9ffc-ac117e378ffa -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f" returned: 0 in 0.502s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:21 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f is being set with open permissions: ugo+rw Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:21 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f Sep 01 01:09:21 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:21 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f" returned: 0 in 0.360s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:21 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015" returned: 0 in 2.707s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_08a90pvldevstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:09:21 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Converted 112.00 MB image at 41.31 MB/s Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:21 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.info Sep 01 01:09:21 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:21 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 1G Sep 01 01:09:21 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:21 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.info" returned: 0 in 0.342s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:21 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.info is being set with open permissions: ugo+rw Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:21 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.info Sep 01 01:09:21 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:21 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 1G" returned: 0 in 0.411s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Downloaded image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}])) to volume 7ea7772d-7e64-4d4a-a10f-38d2c3dae015 successfully. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Temporary image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 for user 61ad5c970c4e4dcbaefa3dbcd4d1da75 is deleted. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:09:21 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Marking volume 7ea7772d-7e64-4d4a-a10f-38d2c3dae015 as bootable. {{(pid=87064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:09:22 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Copying metadata from image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 to 7ea7772d-7e64-4d4a-a10f-38d2c3dae015. {{(pid=87064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:09:22 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Creating volume glance metadata for volume 7ea7772d-7e64-4d4a-a10f-38d2c3dae015 backed by image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:09:22 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c10d6c-9708-410c-b442-c658e1ca95bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:22 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad35da40-d334-4307-ab5e-f9fba546674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:22 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Volume volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 (7ea7772d-7e64-4d4a-a10f-38d2c3dae015): created successfully Sep 01 01:09:22 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad35da40-d334-4307-ab5e-f9fba546674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:22 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Flow 'volume_create_manager' (16985e44-ba29-45eb-96a6-afd68410026d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:22 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-858bf8df-aa32-43d1-b528-2dba20d9c741 tempest-ServerActionsTestOtherA-2054217892 None] Created volume successfully. Sep 01 01:09:22 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.info" returned: 0 in 0.334s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.953s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:22 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7c421d39-2dd3-4343-b1ee-3146ceb68638 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Create snapshot completed successfully Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Acquiring lock "cinder-1c735de8-43f6-4b32-966b-8ee4f838b51f-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "cinder-1c735de8-43f6-4b32-966b-8ee4f838b51f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Acquiring lock "cinder-quobyte-385b651a-df08-446a-9ffc-ac117e378ffa" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "cinder-quobyte-385b651a-df08-446a-9ffc-ac117e378ffa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Acquiring lock "cinder-quobyte-1c735de8-43f6-4b32-966b-8ee4f838b51f" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "cinder-quobyte-1c735de8-43f6-4b32-966b-8ee4f838b51f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Deleting offline snapshot 1c735de8-43f6-4b32-966b-8ee4f838b51f of volume 385b651a-df08-446a-9ffc-ac117e378ffa {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] snapshot_file for this snap is: volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec9deef-8f4b-4713-af50-7fd209e1b1c2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:23 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f Sep 01 01:09:23 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:23 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f" returned: 0 in 0.498s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-385b651a-df08-446a-9ffc-ac117e378ffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa750332-d855-4198-954c-50abf936d523]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:23 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa Sep 01 01:09:23 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:24 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa" returned: 0 in 0.462s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:24 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f Sep 01 01:09:24 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:24 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f" returned: 0 in 0.502s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:24 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f Sep 01 01:09:24 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:25 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa.1c735de8-43f6-4b32-966b-8ee4f838b51f" returned: 0 in 0.430s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "cinder-quobyte-1c735de8-43f6-4b32-966b-8ee4f838b51f" released by "_delete_snapshot" :: held 2.141s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "cinder-quobyte-385b651a-df08-446a-9ffc-ac117e378ffa" released by "delete_snapshot" :: held 2.183s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:25 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Created reservations ['bff71b2f-b1e9-4a34-a2b3-b9d3806a8dc1', '83c94afa-1472-4deb-af31-6ef8b28fcf69', 'b08e3b2b-a56f-4f22-afb9-176701023809', '715a1ea9-75fe-43d0-af21-bb71c17292de'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:09:25 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Delete snapshot completed successfully. Sep 01 01:09:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d06d4738-4b7a-46c8-ba03-5544ab6e94ae tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "cinder-1c735de8-43f6-4b32-966b-8ee4f838b51f-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Acquiring lock "cinder-385b651a-df08-446a-9ffc-ac117e378ffa-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "cinder-385b651a-df08-446a-9ffc-ac117e378ffa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Acquiring lock "cinder-quobyte-385b651a-df08-446a-9ffc-ac117e378ffa" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "cinder-quobyte-385b651a-df08-446a-9ffc-ac117e378ffa" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:26 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5836590e-bf13-49b1-aa31-df81dbebd3e6]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:27 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa Sep 01 01:09:27 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-32fc6535-d1fb-46f0-b3c5-2ae4da89854b req-52943ce3-4725-4981-a50a-b145a8245ea2 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-32fc6535-d1fb-46f0-b3c5-2ae4da89854b req-52943ce3-4725-4981-a50a-b145a8245ea2 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-32fc6535-d1fb-46f0-b3c5-2ae4da89854b req-52943ce3-4725-4981-a50a-b145a8245ea2 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-32fc6535-d1fb-46f0-b3c5-2ae4da89854b req-52943ce3-4725-4981-a50a-b145a8245ea2 tempest-ServerActionsTestOtherA-2054217892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '511d52bb-1324-43ea-90f7-38a334aad693', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:09:27 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa" returned: 0 in 0.663s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:27 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa Sep 01 01:09:27 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:27 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-32fc6535-d1fb-46f0-b3c5-2ae4da89854b req-52943ce3-4725-4981-a50a-b145a8245ea2 tempest-ServerActionsTestOtherA-2054217892 None] attachment_update completed successfully. Sep 01 01:09:28 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-385b651a-df08-446a-9ffc-ac117e378ffa" returned: 0 in 0.517s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "cinder-quobyte-385b651a-df08-446a-9ffc-ac117e378ffa" released by "delete_volume" :: held 1.339s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Created reservations ['9fe69e05-50cc-4196-b7d9-b4f059a64841', 'c738f32a-8730-4961-8ccb-1a8163185226', 'a85fb618-1a52-418a-836a-c516ea1a9bbc', 'b0bf4168-4b21-41df-9e94-0d8bc8da4509'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:28 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:09:28 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:28 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.410s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:09:28 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Deleted volume successfully. Sep 01 01:09:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f61065f1-9d09-4cec-8162-418c06b93699 tempest-VolumeSnapshotQuotasNegativeTestJSON-2120209748 None] Lock "cinder-385b651a-df08-446a-9ffc-ac117e378ffa-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Flow 'volume_create_manager' (9565211b-fa48-4ed8-971a-a04f84207185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f6b356-1522-4a21-afd1-0d4626841d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f6b356-1522-4a21-afd1-0d4626841d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1203048044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d509bdb-f28d-447f-8bbe-d08d2c3b0029,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eda0b62ac2c547829e2ce1aaa84c202f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:32Z,use_quota=True,user_id='f22bc6cb45d84acd82742dcaf1a6aa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4240c7-52a1-4ac2-a52f-0e97a92d29dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4240c7-52a1-4ac2-a52f-0e97a92d29dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac0c59e-f58e-4021-9120-f21c17df216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac0c59e-f58e-4021-9120-f21c17df216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d509bdb-f28d-447f-8bbe-d08d2c3b0029', 'volume_name': 'volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7539b6bf-1306-40a5-b9b9-93bf8780021b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7539b6bf-1306-40a5-b9b9-93bf8780021b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88692c1d-151d-4879-ab57-03be08cfb215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:31 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Volume 9d509bdb-f28d-447f-8bbe-d08d2c3b0029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029', 'volume_size': 1} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1203048044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d509bdb-f28d-447f-8bbe-d08d2c3b0029,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eda0b62ac2c547829e2ce1aaa84c202f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:32Z,use_quota=True,user_id='f22bc6cb45d84acd82742dcaf1a6aa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Creating volume 9d509bdb-f28d-447f-8bbe-d08d2c3b0029 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:09:31 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:09:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:32 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029 1073741824 Sep 01 01:09:32 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:33 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029 1073741824" returned: 0 in 1.064s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:33 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029 Sep 01 01:09:33 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:33 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029" returned: 0 in 0.494s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:09:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88692c1d-151d-4879-ab57-03be08cfb215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638a13df-cc41-4e57-97ec-71d4ef7f25f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:33 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Volume volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029 (9d509bdb-f28d-447f-8bbe-d08d2c3b0029): created successfully Sep 01 01:09:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638a13df-cc41-4e57-97ec-71d4ef7f25f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Flow 'volume_create_manager' (9565211b-fa48-4ed8-971a-a04f84207185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:33 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2aeac4c3-b946-4f87-be24-2b11c931ef88 tempest-VolumesTestJSON-1050902558 None] Created volume successfully. Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Flow 'volume_create_manager' (82136bbc-e182-4b71-90b0-c912a0d1ce4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bea8e5-4d3a-4395-b522-2de866d58840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bea8e5-4d3a-4395-b522-2de866d58840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-502940779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910d0119-1357-47b7-93e7-065a72057b10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eda0b62ac2c547829e2ce1aaa84c202f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:35Z,use_quota=True,user_id='f22bc6cb45d84acd82742dcaf1a6aa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d797a421-9aab-4df8-ae65-c3aeff41e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d797a421-9aab-4df8-ae65-c3aeff41e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc78bca2-abfe-4009-a9d3-9e5791bc0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc78bca2-abfe-4009-a9d3-9e5791bc0d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910d0119-1357-47b7-93e7-065a72057b10', 'volume_name': 'volume-910d0119-1357-47b7-93e7-065a72057b10', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691ea538-fe6e-4360-9886-a55468d02607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691ea538-fe6e-4360-9886-a55468d02607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6f164f-ca08-4291-b582-73f2a7a92027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:35 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Volume 910d0119-1357-47b7-93e7-065a72057b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910d0119-1357-47b7-93e7-065a72057b10', 'volume_size': 1} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-502940779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910d0119-1357-47b7-93e7-065a72057b10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eda0b62ac2c547829e2ce1aaa84c202f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:35Z,use_quota=True,user_id='f22bc6cb45d84acd82742dcaf1a6aa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Creating volume 910d0119-1357-47b7-93e7-065a72057b10 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:09:35 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:09:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:35 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10 1073741824 Sep 01 01:09:35 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:36 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10 1073741824" returned: 0 in 0.943s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:36 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10 Sep 01 01:09:36 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:37 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10" returned: 0 in 0.519s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:37 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:09:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6f164f-ca08-4291-b582-73f2a7a92027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910d0119-1357-47b7-93e7-065a72057b10', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282e5d52-4909-4ae7-8f63-7b87298bd7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:37 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Volume volume-910d0119-1357-47b7-93e7-065a72057b10 (910d0119-1357-47b7-93e7-065a72057b10): created successfully Sep 01 01:09:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282e5d52-4909-4ae7-8f63-7b87298bd7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Flow 'volume_create_manager' (82136bbc-e182-4b71-90b0-c912a0d1ce4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:37 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ca541a53-ce8e-47ef-8989-340caa2173c3 tempest-VolumesTestJSON-1050902558 None] Created volume successfully. Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Flow 'volume_create_manager' (f854a149-ebbb-4543-81d9-92b95fe81556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949196da-a73b-40c6-8582-9b7630f65fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949196da-a73b-40c6-8582-9b7630f65fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1321951953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eda0b62ac2c547829e2ce1aaa84c202f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:39Z,use_quota=True,user_id='f22bc6cb45d84acd82742dcaf1a6aa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd3df76-3b56-4f48-851a-a618a62d2ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd3df76-3b56-4f48-851a-a618a62d2ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd3a5a8-a5ef-4952-a06f-e1ff3c10e4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd3a5a8-a5ef-4952-a06f-e1ff3c10e4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1', 'volume_name': 'volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e2e2e1-8205-4797-a6a6-1ba061bfbdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e2e2e1-8205-4797-a6a6-1ba061bfbdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9bc509-5e0a-499e-a991-fd88ab5c10f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Volume a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1', 'volume_size': 1} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1321951953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eda0b62ac2c547829e2ce1aaa84c202f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:39Z,use_quota=True,user_id='f22bc6cb45d84acd82742dcaf1a6aa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Creating volume a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:09:39 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:09:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:39 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1 1073741824 Sep 01 01:09:39 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:40 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1 1073741824" returned: 0 in 1.192s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:40 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1 Sep 01 01:09:40 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:41 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1" returned: 0 in 0.468s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:09:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9bc509-5e0a-499e-a991-fd88ab5c10f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73348124-7146-43c7-a923-9fd3f7874ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:41 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Volume volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1 (a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1): created successfully Sep 01 01:09:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73348124-7146-43c7-a923-9fd3f7874ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Flow 'volume_create_manager' (f854a149-ebbb-4543-81d9-92b95fe81556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:41 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8f0fa786-cd27-4b74-bc1c-ec9c70c602e4 tempest-VolumesTestJSON-1050902558 None] Created volume successfully. Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Flow 'volume_create_manager' (c7e19fa9-f931-414c-9195-e46b7ae6ecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1433ce-103e-448d-8b00-fd7e36104368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1433ce-103e-448d-8b00-fd7e36104368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1559801240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e0e74e-9171-43eb-8886-c845d109fe05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d48c964cc98d48258b8d9d9791274752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:43Z,use_quota=True,user_id='2019eab206cd470d87fba99c7e30bd7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6571fe3-6e92-4fd3-a718-98972fe0280d),volume_type_id=e6571fe3-6e92-4fd3-a718-98972fe0280d)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8364d4-3399-41ff-a69a-7afb7289c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8364d4-3399-41ff-a69a-7afb7289c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cff8a6-d388-44be-ad80-d6cc9d65578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cff8a6-d388-44be-ad80-d6cc9d65578a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e0e74e-9171-43eb-8886-c845d109fe05', 'volume_name': 'volume-92e0e74e-9171-43eb-8886-c845d109fe05', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d15417b3-0336-4f0d-b8b5-9f761b27bf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d15417b3-0336-4f0d-b8b5-9f761b27bf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff1ff20-cee4-4648-a355-501016ea5337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:43 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Volume 92e0e74e-9171-43eb-8886-c845d109fe05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e0e74e-9171-43eb-8886-c845d109fe05', 'volume_size': 1} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1559801240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e0e74e-9171-43eb-8886-c845d109fe05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d48c964cc98d48258b8d9d9791274752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:43Z,use_quota=True,user_id='2019eab206cd470d87fba99c7e30bd7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6571fe3-6e92-4fd3-a718-98972fe0280d),volume_type_id=e6571fe3-6e92-4fd3-a718-98972fe0280d)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Creating volume 92e0e74e-9171-43eb-8886-c845d109fe05 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:09:43 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:09:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:43 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05 1073741824 Sep 01 01:09:43 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:44 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05 1073741824" returned: 0 in 0.850s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:44 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05 Sep 01 01:09:44 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "cinder-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Lock "cinder-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "cinder-quobyte-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Lock "cinder-quobyte-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1" acquired by "delete_volume" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d69fdf0-1c50-4cc4-8b74-bd704e077b34]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:44 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1 Sep 01 01:09:44 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:44 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05" returned: 0 in 0.618s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff1ff20-cee4-4648-a355-501016ea5337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e0e74e-9171-43eb-8886-c845d109fe05', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b55228c-b746-427c-9688-062146ab0a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:44 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Volume volume-92e0e74e-9171-43eb-8886-c845d109fe05 (92e0e74e-9171-43eb-8886-c845d109fe05): created successfully Sep 01 01:09:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b55228c-b746-427c-9688-062146ab0a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Flow 'volume_create_manager' (c7e19fa9-f931-414c-9195-e46b7ae6ecd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-aaa72944-61b7-4e40-bc95-728e8172436b tempest-VolumeTypesAccessTest-1248948415 None] Created volume successfully. Sep 01 01:09:45 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1" returned: 0 in 0.817s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:45 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1 Sep 01 01:09:45 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Acquiring lock "cinder-92e0e74e-9171-43eb-8886-c845d109fe05-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Lock "cinder-92e0e74e-9171-43eb-8886-c845d109fe05-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Acquiring lock "cinder-quobyte-92e0e74e-9171-43eb-8886-c845d109fe05" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Lock "cinder-quobyte-92e0e74e-9171-43eb-8886-c845d109fe05" acquired by "delete_volume" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:45 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[200130a3-7a08-4af0-b67e-c61e04cb1ea2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:46 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1" returned: 0 in 0.628s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Lock "cinder-quobyte-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1" released by "delete_volume" :: held 1.517s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:46 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05 Sep 01 01:09:46 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Created reservations ['f88bf04c-5fa5-4971-9da7-298c3219f390', 'a433b384-e216-40db-905b-c3c8b8ee1815', 'ab6f37a2-e201-48f8-bd3f-a58bdb549ab0', '93c12d19-19f0-48d8-af9c-fdd77261e578'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:46 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:09:46 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:46 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05" returned: 0 in 0.780s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:46 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05 Sep 01 01:09:46 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:46 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.420s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:46 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:09:46 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Deleted volume successfully. Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dce7a89-617b-4525-8264-a407ed35aa16 tempest-VolumesTestJSON-1050902558 None] Lock "cinder-a1f8c33e-647e-4a32-9b3d-67a3d5c44ab1-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:47 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-92e0e74e-9171-43eb-8886-c845d109fe05" returned: 0 in 0.468s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Lock "cinder-quobyte-92e0e74e-9171-43eb-8886-c845d109fe05" released by "delete_volume" :: held 1.347s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "cinder-910d0119-1357-47b7-93e7-065a72057b10-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:47 devstack cinder-volume[87064]: WARNING cinder.quota [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1934084158 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1934084158, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:09:47 devstack cinder-volume[87064]: WARNING cinder.quota [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1934084158 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1934084158, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Lock "cinder-910d0119-1357-47b7-93e7-065a72057b10-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Created reservations ['a5d61c51-8b84-456d-886d-baa641cd8f89', 'eab7369a-4df9-4743-a227-0a0a194cbf0d', '3fcd272b-41f3-4ccd-bd44-d77115a3ddbb', 'a9c5e4cb-f407-4a20-83f5-37e4a2cffd7c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "cinder-quobyte-910d0119-1357-47b7-93e7-065a72057b10" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Lock "cinder-quobyte-910d0119-1357-47b7-93e7-065a72057b10" acquired by "delete_volume" :: waited 0.037s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e7d0a3-d714-41a2-930e-065a6393553f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:47 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:09:47 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:47 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-68d3de99-d004-4a24-b241-181092df49bb req-e4b3aa59-ddd8-4bc7-9ec3-9724fbeb3ea5 tempest-ServerActionsTestOtherA-2054217892 None] Terminate volume connection completed successfully. Sep 01 01:09:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-68d3de99-d004-4a24-b241-181092df49bb req-e4b3aa59-ddd8-4bc7-9ec3-9724fbeb3ea5 tempest-ServerActionsTestOtherA-2054217892 None] Deleting attachment 511d52bb-1324-43ea-90f7-38a334aad693. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:09:47 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10 Sep 01 01:09:47 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:48 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.412s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:48 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:09:48 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Deleted volume successfully. Sep 01 01:09:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f105107c-adf8-4b96-8f60-0a81fcda3a60 tempest-VolumeTypesAccessTest-1248948415 None] Lock "cinder-92e0e74e-9171-43eb-8886-c845d109fe05-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:48 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10" returned: 0 in 0.764s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:48 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10 Sep 01 01:09:48 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:48 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-910d0119-1357-47b7-93e7-065a72057b10" returned: 0 in 0.357s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Lock "cinder-quobyte-910d0119-1357-47b7-93e7-065a72057b10" released by "delete_volume" :: held 1.260s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:48 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Created reservations ['b79c5eaa-4bf5-4106-8d3f-0508ce4e34c2', '81076a4e-ba75-422b-82fb-42a79a9717be', 'e90283f6-55b8-4e33-837d-327896dc876c', '354006a4-0a27-4a05-90ef-621cc88a8f6c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:49 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:09:49 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:49 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.375s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:09:49 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Deleted volume successfully. Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-25890cdc-8d7d-4279-ab8b-ae8bb7d5fd87 tempest-VolumesTestJSON-1050902558 None] Lock "cinder-910d0119-1357-47b7-93e7-065a72057b10-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Acquiring lock "cinder-9d509bdb-f28d-447f-8bbe-d08d2c3b0029-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Lock "cinder-9d509bdb-f28d-447f-8bbe-d08d2c3b0029-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Acquiring lock "cinder-quobyte-9d509bdb-f28d-447f-8bbe-d08d2c3b0029" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:09:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Lock "cinder-quobyte-9d509bdb-f28d-447f-8bbe-d08d2c3b0029" acquired by "delete_volume" :: waited 0.038s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:09:50 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cb84db-bacb-430a-b848-32990d0eacaa]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:50 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029 Sep 01 01:09:50 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-68d3de99-d004-4a24-b241-181092df49bb req-bb6f9322-150d-43c1-be39-6e7af5183aba tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-68d3de99-d004-4a24-b241-181092df49bb req-bb6f9322-150d-43c1-be39-6e7af5183aba tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-68d3de99-d004-4a24-b241-181092df49bb req-bb6f9322-150d-43c1-be39-6e7af5183aba tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-68d3de99-d004-4a24-b241-181092df49bb req-bb6f9322-150d-43c1-be39-6e7af5183aba tempest-ServerActionsTestOtherA-2054217892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98a85dc0-c1c8-4a35-8257-30bf7f93c090', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:09:50 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-68d3de99-d004-4a24-b241-181092df49bb req-bb6f9322-150d-43c1-be39-6e7af5183aba tempest-ServerActionsTestOtherA-2054217892 None] attachment_update completed successfully. Sep 01 01:09:50 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029" returned: 0 in 0.523s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:50 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029 Sep 01 01:09:50 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:50 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d509bdb-f28d-447f-8bbe-d08d2c3b0029" returned: 0 in 0.390s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:50 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Lock "cinder-quobyte-9d509bdb-f28d-447f-8bbe-d08d2c3b0029" released by "delete_volume" :: held 1.001s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:51 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Created reservations ['53066a31-510c-4757-aff8-1936f1f41574', '07cfdcb7-94f6-4c31-b72d-6a6463cbbc3b', '463e3f25-1358-4350-9be7-dc8c8147d595', '1981ef90-268c-423e-a4d2-3d7798a958b6'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:09:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:51 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:09:51 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:51 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.528s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:51 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:09:51 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Deleted volume successfully. Sep 01 01:09:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5d95e28f-aef2-4a06-8f0d-51012443960a tempest-VolumesTestJSON-1050902558 None] Lock "cinder-9d509bdb-f28d-447f-8bbe-d08d2c3b0029-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:09:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:09:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:52 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:09:52 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Flow 'volume_create_manager' (7b6befa7-e0c9-4b86-9c46-93c5eeb48559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d431bbd3-fc01-450e-8076-4250fa3abd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:53 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d431bbd3-fc01-450e-8076-4250fa3abd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-974127694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9ba7d1-6622-4658-aba9-c63b339d6b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5e12797d0b4582a9f9a8f72a2085d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:53Z,use_quota=True,user_id='75981b6758414dc4b5442890690e86b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fe9307-492d-4c6e-82db-d90af02ff47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fe9307-492d-4c6e-82db-d90af02ff47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d0b039-9e78-4a96-8eac-506f41448306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG cinder.image.glance [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Creating Keystone auth plugin from conf {{(pid=87064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.681s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:09:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:09:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d0b039-9e78-4a96-8eac-506f41448306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce9ba7d1-6622-4658-aba9-c63b339d6b8b', 'volume_name': 'volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a370605-17a3-4558-99df-3c89f43c2ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a370605-17a3-4558-99df-3c89f43c2ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:09:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d8898a-1518-4286-a642-2e812d985693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:09:54 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Volume ce9ba7d1-6622-4658-aba9-c63b339d6b8b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 01:09:54 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Trying to clone ce9ba7d1-6622-4658-aba9-c63b339d6b8b from image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]). {{(pid=87064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:09:55 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:09:55 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Image download 20.69 MB at 20.69 MB/s Sep 01 01:09:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c008c2c-5ec8-4074-b80d-4586f44f553c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:55 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD Sep 01 01:09:55 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:55 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD" returned: 0 in 0.525s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:55 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Temporary image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 is fetched for user 75981b6758414dc4b5442890690e86b2. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:09:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3c27c2-63c4-4f6d-9ee5-40c12e21f641]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:56 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD Sep 01 01:09:56 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:56 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD" returned: 0 in 0.920s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-974127694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9ba7d1-6622-4658-aba9-c63b339d6b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5e12797d0b4582a9f9a8f72a2085d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:09:53Z,use_quota=True,user_id='75981b6758414dc4b5442890690e86b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Creating volume ce9ba7d1-6622-4658-aba9-c63b339d6b8b {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:09:56 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:09:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:56 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b 1073741824 Sep 01 01:09:56 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:57 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b 1073741824" returned: 0 in 1.006s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:58 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b Sep 01 01:09:58 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:58 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b" returned: 0 in 0.710s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:09:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:09:58 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Attempting download of 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}])) to volume ce9ba7d1-6622-4658-aba9-c63b339d6b8b. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:09:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c77a23-dde0-45c7-80c9-e01d7ec22f04]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:09:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_z84uqbna {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:09:59 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_z84uqbna Sep 01 01:09:59 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:09:59 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 01 01:09:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_z84uqbna" returned: 0 in 0.846s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:09:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_z84uqbna {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:00 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_z84uqbna Sep 01 01:10:00 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:00 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_z84uqbna" returned: 1 in 0.756s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_z84uqbna' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:10:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f0aa45-06f5-413a-82e0-a73e7739c3df]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:00 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD Sep 01 01:10:00 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:01 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD" returned: 0 in 0.600s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:01 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 was qcow2, converting to qcow2 {{(pid=87064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:10:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:01 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b Sep 01 01:10:01 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:03 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b" returned: 0 in 2.761s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:03 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_opzl2s4odevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:10:03 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Converted 112.00 MB image at 40.49 MB/s Sep 01 01:10:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:03 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b 1G Sep 01 01:10:03 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:04 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b 1G" returned: 0 in 0.551s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:04 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Downloaded image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}])) to volume ce9ba7d1-6622-4658-aba9-c63b339d6b8b successfully. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:10:04 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Temporary image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 for user 75981b6758414dc4b5442890690e86b2 is deleted. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:10:04 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Marking volume ce9ba7d1-6622-4658-aba9-c63b339d6b8b as bootable. {{(pid=87064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:10:04 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Copying metadata from image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 to ce9ba7d1-6622-4658-aba9-c63b339d6b8b. {{(pid=87064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:10:04 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Creating volume glance metadata for volume ce9ba7d1-6622-4658-aba9-c63b339d6b8b backed by image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:10:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d8898a-1518-4286-a642-2e812d985693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964f09a6-fdd4-4066-92c6-682c2e313999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:04 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Volume volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b (ce9ba7d1-6622-4658-aba9-c63b339d6b8b): created successfully Sep 01 01:10:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964f09a6-fdd4-4066-92c6-682c2e313999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Flow 'volume_create_manager' (7b6befa7-e0c9-4b86-9c46-93c5eeb48559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:04 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-66d65fd5-a249-42cc-86ba-ce0f1b0e1999 tempest-VolumesImageMetadata-1047948980 None] Created volume successfully. Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Acquiring lock "cinder-ce9ba7d1-6622-4658-aba9-c63b339d6b8b-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Lock "cinder-ce9ba7d1-6622-4658-aba9-c63b339d6b8b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Acquiring lock "cinder-quobyte-ce9ba7d1-6622-4658-aba9-c63b339d6b8b" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Lock "cinder-quobyte-ce9ba7d1-6622-4658-aba9-c63b339d6b8b" acquired by "delete_volume" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2a8821-d1fb-43f4-9c5f-e45c4ff0ad56]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:06 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b Sep 01 01:10:06 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Flow 'volume_create_manager' (a7c5ec17-dca3-4e9f-aca8-2a47deae99c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d87927-e128-48de-9088-969784c8c04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d87927-e128-48de-9088-969784c8c04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-708625296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6443f7e7-1c1d-4a8a-ad0d-234ae81dc090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21483355a8c4bc7b3d231775e016385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:07Z,use_quota=True,user_id='fdaec17a6ccc44cb84fc2cdbb8678a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e27c66-7322-410a-a5b2-824c2552a7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e27c66-7322-410a-a5b2-824c2552a7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbf2655-10a3-4b3d-aa47-e1126298e390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbf2655-10a3-4b3d-aa47-e1126298e390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6443f7e7-1c1d-4a8a-ad0d-234ae81dc090', 'volume_name': 'volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175a31a9-cf8f-40dd-add8-f4902f012e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175a31a9-cf8f-40dd-add8-f4902f012e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1f9a64-ffde-4209-ad06-ef72badda9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:06 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Volume 6443f7e7-1c1d-4a8a-ad0d-234ae81dc090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090', 'volume_size': 1} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-708625296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6443f7e7-1c1d-4a8a-ad0d-234ae81dc090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21483355a8c4bc7b3d231775e016385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:07Z,use_quota=True,user_id='fdaec17a6ccc44cb84fc2cdbb8678a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Creating volume 6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:10:06 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:06 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 1073741824 Sep 01 01:10:06 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:06 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b" returned: 0 in 0.505s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:06 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b Sep 01 01:10:06 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:07 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce9ba7d1-6622-4658-aba9-c63b339d6b8b" returned: 0 in 0.498s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Lock "cinder-quobyte-ce9ba7d1-6622-4658-aba9-c63b339d6b8b" released by "delete_volume" :: held 1.084s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Created reservations ['f81f77bd-84c3-4713-b0c4-4d26077140b4', '7eed57cf-b6f2-40f2-8a6d-a82bf9c7f4b0', '7ab0ca40-3927-4bc3-a45d-24048d30c3ab', '3ec8a8aa-48d8-43fe-976e-0a9e3e961ed9'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:07 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 1073741824" returned: 0 in 0.744s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:07 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a47faa4e-f849-4c7f-b926-5764cbdffa3c tempest-GroupSnapshotsV319Test-2038673787 None] Group tempest-GroupSnapshotsV319Test-Group-1157595652: creating Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:07 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 Sep 01 01:10:07 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:07 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a47faa4e-f849-4c7f-b926-5764cbdffa3c tempest-GroupSnapshotsV319Test-2038673787 None] Group tempest-GroupSnapshotsV319Test-Group-1157595652: created successfully Sep 01 01:10:07 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:10:07 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:07 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a47faa4e-f849-4c7f-b926-5764cbdffa3c tempest-GroupSnapshotsV319Test-2038673787 None] Create group completed successfully. Sep 01 01:10:07 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090" returned: 0 in 0.302s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1f9a64-ffde-4209-ad06-ef72badda9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c3ae31-67cb-4e9b-af87-6276dbd9b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:08 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Volume volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 (6443f7e7-1c1d-4a8a-ad0d-234ae81dc090): created successfully Sep 01 01:10:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c3ae31-67cb-4e9b-af87-6276dbd9b918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Flow 'volume_create_manager' (a7c5ec17-dca3-4e9f-aca8-2a47deae99c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:08 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-49006712-d2af-428a-a1ad-95893924b30a tempest-SnapshotMetadataTestJSON-2133968337 None] Created volume successfully. Sep 01 01:10:08 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.311s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:08 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:10:08 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Deleted volume successfully. Sep 01 01:10:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e500b59e-eccb-4b46-8d60-75f899065a23 tempest-VolumesImageMetadata-1047948980 None] Lock "cinder-ce9ba7d1-6622-4658-aba9-c63b339d6b8b-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] Creating offline snapshot 69750f24-79a5-4f44-9094-71a507e647ef of volume 6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:10:08 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05597cc-46ff-4d5f-87de-bffd732bc46d]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:09 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 Sep 01 01:10:09 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:09 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090" returned: 0 in 0.759s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:10:09 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef 1G Sep 01 01:10:09 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Flow 'volume_create_manager' (572c877c-12f3-4ddf-a050-452378e62439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9c8182-f37c-4f25-8e7c-19e7a2a9639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9c8182-f37c-4f25-8e7c-19e7a2a9639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-634253747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1366a665-289e-4bb2-ba78-ead9575f1561,host='devstack@QuobyteHD#QuobyteHD',id=5783a1df-184a-45f5-aa5d-8b67fe26be09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf7f306cf2464eb1893ee00c815c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:10Z,use_quota=True,user_id='ca902c53137046e484db65a7ca50ebac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c383b22-b062-4ced-a1ad-74d257eb9253),volume_type_id=9c383b22-b062-4ced-a1ad-74d257eb9253)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94430b9-c8c6-496a-92f2-4c574136d126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94430b9-c8c6-496a-92f2-4c574136d126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3674918a-632f-434b-ab22-70c096b250a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3674918a-632f-434b-ab22-70c096b250a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5783a1df-184a-45f5-aa5d-8b67fe26be09', 'volume_name': 'volume-5783a1df-184a-45f5-aa5d-8b67fe26be09', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4128878-7b49-4ad9-97fb-362745ffc818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4128878-7b49-4ad9-97fb-362745ffc818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6082a6f9-78a4-4374-94ea-c4d26e9ee474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:10 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Volume 5783a1df-184a-45f5-aa5d-8b67fe26be09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5783a1df-184a-45f5-aa5d-8b67fe26be09', 'volume_size': 1} Sep 01 01:10:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:10 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef 1G" returned: 0 in 0.659s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:10 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef Sep 01 01:10:10 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:10 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef" returned: 0 in 0.375s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:10 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef is being set with open permissions: ugo+rw Sep 01 01:10:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:10 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef Sep 01 01:10:10 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:11 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef" returned: 0 in 0.400s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:11 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.info Sep 01 01:10:11 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:11 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.info" returned: 0 in 0.366s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:11 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.info is being set with open permissions: ugo+rw Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:11 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.info Sep 01 01:10:11 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:11 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.info" returned: 0 in 0.301s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.959s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1366a665-289e-4bb2-ba78-ead9575f1561,created_at=2026-08-31T23:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-634253747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1366a665-289e-4bb2-ba78-ead9575f1561,host='devstack@QuobyteHD#QuobyteHD',id=5783a1df-184a-45f5-aa5d-8b67fe26be09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf7f306cf2464eb1893ee00c815c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:10Z,use_quota=True,user_id='ca902c53137046e484db65a7ca50ebac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c383b22-b062-4ced-a1ad-74d257eb9253),volume_type_id=9c383b22-b062-4ced-a1ad-74d257eb9253)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Creating volume 5783a1df-184a-45f5-aa5d-8b67fe26be09 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:10:11 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:10:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:12 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=106,cinder:UPDATE=105,cinder:INSERT=42,cinder:DELETE=11 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:10:12 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=105,cinder:INSERT=34,cinder:UPDATE=119,cinder:DELETE=7 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:10:12 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f1dbf8c6-497a-4da8-af50-af3684dae28e tempest-SnapshotMetadataTestJSON-2133968337 None] Create snapshot completed successfully Sep 01 01:10:12 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 1073741824 Sep 01 01:10:12 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:12 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 1073741824" returned: 0 in 0.739s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:12 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 Sep 01 01:10:12 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:13 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09" returned: 0 in 0.382s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:10:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6082a6f9-78a4-4374-94ea-c4d26e9ee474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5783a1df-184a-45f5-aa5d-8b67fe26be09', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1db26c-4273-4aab-a7e1-b401ce1a108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:13 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Volume volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 (5783a1df-184a-45f5-aa5d-8b67fe26be09): created successfully Sep 01 01:10:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1db26c-4273-4aab-a7e1-b401ce1a108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Flow 'volume_create_manager' (572c877c-12f3-4ddf-a050-452378e62439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:13 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7e2be5ca-2b6a-4971-88fc-f082f7189a9c tempest-GroupSnapshotsV319Test-2038673787 None] Created volume successfully. Sep 01 01:10:13 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] GroupSnapshot 4760b50b-e572-48b5-9159-a1fff592151b: creating. Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] Group snapshot 4760b50b-e572-48b5-9159-a1fff592151b: creating. {{(pid=87064) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] Creating offline snapshot de84c87d-a7cf-44c3-82ab-386871a18319 of volume 5783a1df-184a-45f5-aa5d-8b67fe26be09 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b065636b-cc39-4037-a501-18c57b503cc9]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:14 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 Sep 01 01:10:14 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Acquiring lock "cinder-69750f24-79a5-4f44-9094-71a507e647ef-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "cinder-69750f24-79a5-4f44-9094-71a507e647ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Acquiring lock "cinder-quobyte-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "cinder-quobyte-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Acquiring lock "cinder-quobyte-69750f24-79a5-4f44-9094-71a507e647ef" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "cinder-quobyte-69750f24-79a5-4f44-9094-71a507e647ef" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Deleting offline snapshot 69750f24-79a5-4f44-9094-71a507e647ef of volume 6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] snapshot_file for this snap is: volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0261879a-0794-4607-9392-270c0907ccd5]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:14 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09" returned: 0 in 0.541s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:14 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef Sep 01 01:10:14 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:14 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 1G Sep 01 01:10:14 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:14 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef" returned: 0 in 0.462s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9528419f-7dd8-4c50-b970-6a5204a79dbb]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:15 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 Sep 01 01:10:15 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:15 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 1G" returned: 0 in 0.526s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:15 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 Sep 01 01:10:15 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:15 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090" returned: 0 in 0.489s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:15 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef Sep 01 01:10:15 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:15 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319" returned: 0 in 0.378s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:15 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:15 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 Sep 01 01:10:15 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:15 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319" returned: 0 in 0.297s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:15 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.info Sep 01 01:10:15 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:15 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef" returned: 0 in 0.428s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:15 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef Sep 01 01:10:15 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:16 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.info" returned: 0 in 0.306s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:16 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:16 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.info Sep 01 01:10:16 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:16 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090.69750f24-79a5-4f44-9094-71a507e647ef" returned: 0 in 0.309s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "cinder-quobyte-69750f24-79a5-4f44-9094-71a507e647ef" released by "_delete_snapshot" :: held 1.827s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "cinder-quobyte-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090" released by "delete_snapshot" :: held 1.860s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Created reservations ['4d898538-b2cd-4bba-ab33-ae1e985d1e37', 'b1bbdad7-2b60-41f8-83ab-fdffd43114a1', '8080f383-4c06-4edf-bb7a-62e3489a2e72', '5dce3b18-2e81-4e56-b101-3b039ba2abf9'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:16 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Delete snapshot completed successfully. Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1a887896-39df-4d94-88a2-0a6a6c11f5a9 tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "cinder-69750f24-79a5-4f44-9094-71a507e647ef-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:16 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.info" returned: 0 in 0.354s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Acquiring lock "cinder-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "cinder-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:16 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-af86ffbd-c330-4d30-8e81-40d6d6724de3 tempest-GroupSnapshotsV319Test-2038673787 None] group_snapshot 4760b50b-e572-48b5-9159-a1fff592151b: created successfully Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Acquiring lock "cinder-quobyte-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "cinder-quobyte-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c03cb7e-c420-487b-8cfd-a45670447fe1]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:16 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 Sep 01 01:10:16 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:17 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090" returned: 0 in 0.529s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:17 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090 Sep 01 01:10:17 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Flow 'volume_create_manager' (b81c21a5-157d-46a4-9ec7-88b5224c5234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5b75fb-51bf-4b84-9d80-d08e13ab3457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5b75fb-51bf-4b84-9d80-d08e13ab3457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-426996168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678fe30a-0e68-47c6-8bed-d21b6b4212da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4278d84631942cda9b5d3c9e353edb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:17Z,use_quota=True,user_id='125f1f1c309f48bf9eee20da17e5bce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b6e083-d01f-404a-b38e-2999d56b7eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b6e083-d01f-404a-b38e-2999d56b7eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b3ed8a-77ab-4db5-a1c2-4470de9a6e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b3ed8a-77ab-4db5-a1c2-4470de9a6e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '678fe30a-0e68-47c6-8bed-d21b6b4212da', 'volume_name': 'volume-678fe30a-0e68-47c6-8bed-d21b6b4212da', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f854f21-d8bf-4811-bb11-db0987955568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f854f21-d8bf-4811-bb11-db0987955568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44034fb8-50d2-4b75-866c-c8c7ef6f8fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:17 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Volume 678fe30a-0e68-47c6-8bed-d21b6b4212da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-678fe30a-0e68-47c6-8bed-d21b6b4212da', 'volume_size': 1} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-426996168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678fe30a-0e68-47c6-8bed-d21b6b4212da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4278d84631942cda9b5d3c9e353edb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:17Z,use_quota=True,user_id='125f1f1c309f48bf9eee20da17e5bce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Creating volume 678fe30a-0e68-47c6-8bed-d21b6b4212da {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:10:17 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:17 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da 1073741824 Sep 01 01:10:17 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:17 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090" returned: 0 in 0.345s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:17 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] group_snapshot 4760b50b-e572-48b5-9159-a1fff592151b: deleting Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "cinder-quobyte-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090" released by "delete_volume" :: held 0.980s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] group_snapshot 4760b50b-e572-48b5-9159-a1fff592151b: deleting {{(pid=87064) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Acquiring lock "cinder-quobyte-5783a1df-184a-45f5-aa5d-8b67fe26be09" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Lock "cinder-quobyte-5783a1df-184a-45f5-aa5d-8b67fe26be09" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Acquiring lock "cinder-quobyte-de84c87d-a7cf-44c3-82ab-386871a18319" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Lock "cinder-quobyte-de84c87d-a7cf-44c3-82ab-386871a18319" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Deleting offline snapshot de84c87d-a7cf-44c3-82ab-386871a18319 of volume 5783a1df-184a-45f5-aa5d-8b67fe26be09 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] snapshot_file for this snap is: volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Created reservations ['0275936c-bf5a-429b-8652-83d6be0bc8ff', '02bc7e2c-d772-4dc8-b92e-e94737dc628c', '0e6966ee-c420-44e7-bc4e-481db159e969', '26027610-c482-4c96-ae8c-3e45d76ec98c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f6d22-1ab6-4361-ad54-563e1d3ddc81]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:18 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:10:18 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:18 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 Sep 01 01:10:18 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:18 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da 1073741824" returned: 0 in 0.600s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:18 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da Sep 01 01:10:18 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:18 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.294s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:10:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Deleted volume successfully. Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e955a42-e0bc-4136-8777-b25731f273fd tempest-SnapshotMetadataTestJSON-2133968337 None] Lock "cinder-6443f7e7-1c1d-4a8a-ad0d-234ae81dc090-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:18 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319" returned: 0 in 0.522s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5783a1df-184a-45f5-aa5d-8b67fe26be09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abb0b4d-1bae-4ab2-b1f7-f1e3b2043577]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:18 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da" returned: 0 in 0.319s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:18 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 Sep 01 01:10:18 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44034fb8-50d2-4b75-866c-c8c7ef6f8fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678fe30a-0e68-47c6-8bed-d21b6b4212da', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecfa5ef-001f-4e36-80a0-ce2f6a18a946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:18 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Volume volume-678fe30a-0e68-47c6-8bed-d21b6b4212da (678fe30a-0e68-47c6-8bed-d21b6b4212da): created successfully Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecfa5ef-001f-4e36-80a0-ce2f6a18a946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Flow 'volume_create_manager' (b81c21a5-157d-46a4-9ec7-88b5224c5234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-16196def-b8fa-4f59-834e-b0cebf2c06da tempest-AbsoluteLimitsTests-250240000 None] Created volume successfully. Sep 01 01:10:18 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09" returned: 0 in 0.404s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:18 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 Sep 01 01:10:18 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:19 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319" returned: 0 in 0.405s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:19 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319 Sep 01 01:10:19 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:19 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09.de84c87d-a7cf-44c3-82ab-386871a18319" returned: 0 in 0.379s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Lock "cinder-quobyte-de84c87d-a7cf-44c3-82ab-386871a18319" released by "_delete_snapshot" :: held 1.855s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Lock "cinder-quobyte-5783a1df-184a-45f5-aa5d-8b67fe26be09" released by "delete_snapshot" :: held 1.897s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Acquiring lock "cinder-678fe30a-0e68-47c6-8bed-d21b6b4212da-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:19 devstack cinder-volume[87064]: WARNING cinder.quota [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-49632368 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-49632368, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:10:19 devstack cinder-volume[87064]: WARNING cinder.quota [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-49632368 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-49632368, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:10:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Lock "cinder-678fe30a-0e68-47c6-8bed-d21b6b4212da-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:19 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] Created reservations ['27e6aedf-9c9f-478e-ae11-a4cfac8c76d0', '79123139-10c2-4a6e-be5d-439682397515', 'ee99ba98-c795-4430-81c9-2f4001329023', '70754391-4c3e-4966-aacf-e41eda66f615'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Acquiring lock "cinder-quobyte-678fe30a-0e68-47c6-8bed-d21b6b4212da" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Lock "cinder-quobyte-678fe30a-0e68-47c6-8bed-d21b6b4212da" acquired by "delete_volume" :: waited 0.064s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:20 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c76576b-7fb3-4c98-a5ed-a2aeeebc4160]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:20 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b3828faa-e1a4-4a9c-99b8-1fc7b6459602 tempest-GroupSnapshotsV319Test-2038673787 None] group_snapshot 4760b50b-e572-48b5-9159-a1fff592151b: deleted successfully Sep 01 01:10:20 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da Sep 01 01:10:20 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Acquiring lock "cinder-quobyte-5783a1df-184a-45f5-aa5d-8b67fe26be09" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Lock "cinder-quobyte-5783a1df-184a-45f5-aa5d-8b67fe26be09" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:20 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da" returned: 0 in 0.587s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:20 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[503572bd-1424-4db4-841a-e519d79c055c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:20 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da Sep 01 01:10:20 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:20 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 Sep 01 01:10:20 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:20 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-678fe30a-0e68-47c6-8bed-d21b6b4212da" returned: 0 in 0.337s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Lock "cinder-quobyte-678fe30a-0e68-47c6-8bed-d21b6b4212da" released by "delete_volume" :: held 1.008s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Created reservations ['a2dde5c8-73e0-41ca-8d65-c7cd8bd26346', '1436685a-eb69-4971-8c03-151e3f2522fa', '8260cade-7017-46a6-a12b-a9ad4f814809', 'cf3cb645-7f99-427d-b0ea-57e5a32225aa'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:21 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:10:21 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:21 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09" returned: 0 in 0.644s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:21 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09 Sep 01 01:10:21 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:21 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:21 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5783a1df-184a-45f5-aa5d-8b67fe26be09" returned: 0 in 0.284s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.391s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Lock "cinder-quobyte-5783a1df-184a-45f5-aa5d-8b67fe26be09" released by "delete_volume" :: held 1.028s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Deleted volume successfully. Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-23a4251f-defb-4c1c-bff2-dd1451d73692 tempest-AbsoluteLimitsTests-250240000 None] Lock "cinder-678fe30a-0e68-47c6-8bed-d21b6b4212da-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Created reservations ['6f9e2603-e5ea-4ad1-b93a-5233d7f2a023'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:21 devstack cinder-volume[87064]: WARNING cinder.quota [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-49632368 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-49632368, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Created reservations ['c5760262-7b87-40d0-b4ee-be8b2ecef43d', 'c4b4e3c1-6f10-4c54-a351-cdbf00408957', '5239515c-d447-402a-a9d2-f7fe6c1c46d5', 'c5007585-7b34-4864-a3df-94ff26878ee3'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:21 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:10:21 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:22 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.300s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:22 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:10:22 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-4ad53baa-88f9-4845-ae9d-d089b294e0ba tempest-GroupSnapshotsV319Test-2038673787 None] Delete group completed successfully. Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Flow 'volume_create_manager' (24017529-365b-4104-a5a3-4a96ca38c289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f8c206-62da-4de4-9684-23bb81a920e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f8c206-62da-4de4-9684-23bb81a920e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-997340847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eae0367-637a-471d-b84f-7716a48a062e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a803ad8e79fe46fa8093a8bc2cce000f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:31Z,use_quota=True,user_id='55b3d134f2e7498fbdf5d44c6f58cc69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7716f52d-ea17-48b5-b4e0-ef7f713b56f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7716f52d-ea17-48b5-b4e0-ef7f713b56f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bdd30e6-b940-46e6-a2c7-748dd803085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bdd30e6-b940-46e6-a2c7-748dd803085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eae0367-637a-471d-b84f-7716a48a062e', 'volume_name': 'volume-0eae0367-637a-471d-b84f-7716a48a062e', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a24969-4a13-48fa-9972-490846cd45f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a24969-4a13-48fa-9972-490846cd45f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7888679-e60f-45b8-84b5-6a578271898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:31 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Volume 0eae0367-637a-471d-b84f-7716a48a062e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eae0367-637a-471d-b84f-7716a48a062e', 'volume_size': 1} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-997340847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eae0367-637a-471d-b84f-7716a48a062e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a803ad8e79fe46fa8093a8bc2cce000f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:31Z,use_quota=True,user_id='55b3d134f2e7498fbdf5d44c6f58cc69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Creating volume 0eae0367-637a-471d-b84f-7716a48a062e {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:10:31 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:31 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-988a6355-85fd-47dd-b201-fbfb433cd9e5 tempest-ServerActionsTestOtherA-2054217892 None] Terminate volume connection completed successfully. Sep 01 01:10:31 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e 1073741824 Sep 01 01:10:31 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-988a6355-85fd-47dd-b201-fbfb433cd9e5 tempest-ServerActionsTestOtherA-2054217892 None] Deleting attachment 98a85dc0-c1c8-4a35-8257-30bf7f93c090. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:10:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "cinder-7ea7772d-7e64-4d4a-a10f-38d2c3dae015-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Lock "cinder-7ea7772d-7e64-4d4a-a10f-38d2c3dae015-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "cinder-quobyte-7ea7772d-7e64-4d4a-a10f-38d2c3dae015" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Lock "cinder-quobyte-7ea7772d-7e64-4d4a-a10f-38d2c3dae015" acquired by "delete_volume" :: waited 0.034s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:32 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba4003c-2540-4717-86e8-6189cf79ff37]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:32 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 Sep 01 01:10:32 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:32 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e 1073741824" returned: 0 in 0.935s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:32 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e Sep 01 01:10:32 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:32 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015" returned: 0 in 0.679s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:32 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015 Sep 01 01:10:32 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "cinder-a564fb07-53ed-433f-b998-69139e9469f1-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Lock "cinder-a564fb07-53ed-433f-b998-69139e9469f1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:33 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e" returned: 0 in 0.681s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7888679-e60f-45b8-84b5-6a578271898d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eae0367-637a-471d-b84f-7716a48a062e', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa63bd7b-44d7-42e0-8aac-e8f5dbc21adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:33 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Volume volume-0eae0367-637a-471d-b84f-7716a48a062e (0eae0367-637a-471d-b84f-7716a48a062e): created successfully Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa63bd7b-44d7-42e0-8aac-e8f5dbc21adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:33 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Flow 'volume_create_manager' (24017529-365b-4104-a5a3-4a96ca38c289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "cinder-quobyte-a564fb07-53ed-433f-b998-69139e9469f1" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7ea7772d-7e64-4d4a-a10f-38d2c3dae015" returned: 0 in 0.702s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Lock "cinder-quobyte-a564fb07-53ed-433f-b998-69139e9469f1" acquired by "delete_volume" :: waited 0.058s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Lock "cinder-quobyte-7ea7772d-7e64-4d4a-a10f-38d2c3dae015" released by "delete_volume" :: held 1.517s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:33 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-1562dfca-10f9-4a8f-9a88-0151d144fdef tempest-VolumesDeleteCascade-946224966 None] Created volume successfully. Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b6df16-058a-4f4b-940d-020e112a94dd]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:33 devstack cinder-volume[87064]: DEBUG cinder.quota [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Created reservations ['d37365fc-7691-4d97-8a52-3837defaabcd', '27b93344-e8fb-480f-8831-8692cf868fb7', 'b5c67020-af6a-4f8e-a3bd-6954351902d2', '99af8252-b24e-4f60-9fe3-844a99ad8f75'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:33 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1 Sep 01 01:10:33 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:34 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:10:34 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:34 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1" returned: 0 in 0.636s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] Creating offline snapshot 6e823dea-5307-4e14-a9d9-180b6d28847f of volume 0eae0367-637a-471d-b84f-7716a48a062e {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:10:34 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1 Sep 01 01:10:34 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57cc08e-c7a0-40c2-838b-a1670d22aeea]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:34 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.491s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG cinder.manager [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:10:34 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e Sep 01 01:10:34 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Deleted volume successfully. Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-2c05ecbf-37fb-4a2d-88be-c7d9d02924a8 req-b18027bb-41a7-4e17-a920-12d8cd5d2020 tempest-ServerActionsTestOtherA-2054217892 None] Lock "cinder-7ea7772d-7e64-4d4a-a10f-38d2c3dae015-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:34 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a564fb07-53ed-433f-b998-69139e9469f1" returned: 0 in 0.501s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Lock "cinder-quobyte-a564fb07-53ed-433f-b998-69139e9469f1" released by "delete_volume" :: held 1.237s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Created reservations ['85f95bc1-342e-4a69-88ee-1238f31bbdb4', 'f083ff98-9f84-4c54-9837-343dfd739051', 'c9e81f88-4c37-42c9-8bfe-e732d5353be9', '61f1f47c-a602-494e-a5a0-58e5ef57e529'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:35 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e" returned: 0 in 0.685s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:35 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:10:35 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:35 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f 1G Sep 01 01:10:35 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:35 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.563s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:10:35 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Deleted volume successfully. Sep 01 01:10:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0a9cd4a2-e87a-4ed1-a7a8-d29d6953d692 tempest-ServerActionsTestOtherA-2054217892 None] Lock "cinder-a564fb07-53ed-433f-b998-69139e9469f1-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:36 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f 1G" returned: 0 in 1.192s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eae0367-637a-471d-b84f-7716a48a062e -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:36 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eae0367-637a-471d-b84f-7716a48a062e -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f Sep 01 01:10:36 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:37 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eae0367-637a-471d-b84f-7716a48a062e -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f" returned: 0 in 0.730s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:37 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f is being set with open permissions: ugo+rw Sep 01 01:10:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:37 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f Sep 01 01:10:37 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:37 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f" returned: 0 in 0.549s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:37 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.info Sep 01 01:10:37 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:37 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:10:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Flow 'volume_create_manager' (c106ae01-be81-43e9-b8e5-4e23e3c79f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b77c8e0-9c25-4fd2-9e04-4918b602cce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b77c8e0-9c25-4fd2-9e04-4918b602cce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1781900875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a596e6-880c-4577-8ee1-76b925b11eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4d71d5ac3084f74bb7a6fd044fc19fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:38Z,use_quota=True,user_id='fffa0569538e4e2c82832ad9f9c61d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc4c7ef-51b6-4182-b0ec-1c40c24fc82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc4c7ef-51b6-4182-b0ec-1c40c24fc82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef66a301-9ffb-4222-bc0c-f5b9d464868b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef66a301-9ffb-4222-bc0c-f5b9d464868b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a596e6-880c-4577-8ee1-76b925b11eda', 'volume_name': 'volume-f9a596e6-880c-4577-8ee1-76b925b11eda', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b738466-ced1-48e9-bd65-2455fc69dad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b738466-ced1-48e9-bd65-2455fc69dad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:38 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9e0130-c4dd-4304-ab8a-18c8f60bca36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:38 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Volume f9a596e6-880c-4577-8ee1-76b925b11eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a596e6-880c-4577-8ee1-76b925b11eda', 'volume_size': 1} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.info" returned: 0 in 0.347s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:38 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.info is being set with open permissions: ugo+rw Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:38 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.info Sep 01 01:10:38 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:38 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.info" returned: 0 in 0.305s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1781900875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a596e6-880c-4577-8ee1-76b925b11eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4d71d5ac3084f74bb7a6fd044fc19fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:38Z,use_quota=True,user_id='fffa0569538e4e2c82832ad9f9c61d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Creating volume f9a596e6-880c-4577-8ee1-76b925b11eda {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:10:38 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:10:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:38 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda 1073741824 Sep 01 01:10:38 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:38 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3aa76452-9e75-4eb6-8cf7-5975df000055 tempest-VolumesDeleteCascade-946224966 None] Create snapshot completed successfully Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:39 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda 1073741824" returned: 0 in 0.765s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:39 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda Sep 01 01:10:39 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:39 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda" returned: 0 in 0.270s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.481s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9e0130-c4dd-4304-ab8a-18c8f60bca36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a596e6-880c-4577-8ee1-76b925b11eda', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2880d897-8240-433f-b545-400faf69c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] Creating offline snapshot 6c4165d0-caaf-4f3a-99fa-b882671503a4 of volume 0eae0367-637a-471d-b84f-7716a48a062e {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:10:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Volume volume-f9a596e6-880c-4577-8ee1-76b925b11eda (f9a596e6-880c-4577-8ee1-76b925b11eda): created successfully Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2880d897-8240-433f-b545-400faf69c755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Flow 'volume_create_manager' (c106ae01-be81-43e9-b8e5-4e23e3c79f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e656486-87f6-452a-80d8-61b2cb298baf]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:39 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3a02d7db-5200-4fff-9a95-aa05f396ae9a tempest-VolumesActionsTest-2123069200 None] Created volume successfully. Sep 01 01:10:39 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f Sep 01 01:10:39 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:40 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f" returned: 0 in 0.462s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eae0367-637a-471d-b84f-7716a48a062e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:10:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:40 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 1G Sep 01 01:10:40 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:40 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 1G" returned: 0 in 0.809s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:40 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 Sep 01 01:10:40 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:41 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4" returned: 0 in 0.415s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:41 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 is being set with open permissions: ugo+rw Sep 01 01:10:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:41 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 Sep 01 01:10:41 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:41 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4" returned: 0 in 0.381s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:41 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-68f3273a-8771-4c57-b7d4-436e4c168f76 tempest-VolumesDeleteCascade-946224966 None] Create snapshot completed successfully Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-0eae0367-637a-471d-b84f-7716a48a062e-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-0eae0367-637a-471d-b84f-7716a48a062e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Performing cascade delete. {{(pid=87064) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-6c4165d0-caaf-4f3a-99fa-b882671503a4-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-6c4165d0-caaf-4f3a-99fa-b882671503a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-quobyte-0eae0367-637a-471d-b84f-7716a48a062e" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-0eae0367-637a-471d-b84f-7716a48a062e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-quobyte-6c4165d0-caaf-4f3a-99fa-b882671503a4" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-6c4165d0-caaf-4f3a-99fa-b882671503a4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Deleting offline snapshot 6c4165d0-caaf-4f3a-99fa-b882671503a4 of volume 0eae0367-637a-471d-b84f-7716a48a062e {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] snapshot_file for this snap is: volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[169be67f-532d-4d0b-908b-4b668e150280]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:42 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 Sep 01 01:10:42 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:43 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4" returned: 0 in 0.647s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eae0367-637a-471d-b84f-7716a48a062e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:10:43 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2ae806-ff8e-452b-bc32-9907dc24ef99]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:43 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f Sep 01 01:10:43 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:43 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f" returned: 0 in 0.591s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eae0367-637a-471d-b84f-7716a48a062e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:10:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:43 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 Sep 01 01:10:43 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:44 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4" returned: 0 in 0.669s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:44 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4 Sep 01 01:10:44 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:44 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6c4165d0-caaf-4f3a-99fa-b882671503a4" returned: 0 in 0.407s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-6c4165d0-caaf-4f3a-99fa-b882671503a4" released by "_delete_snapshot" :: held 2.472s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-0eae0367-637a-471d-b84f-7716a48a062e" released by "delete_snapshot" :: held 2.514s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Created reservations ['6f1159a6-1f0e-4d53-aa0f-e056c864d9b8', 'ff5d6231-85e8-4e5c-9c54-16e5246ab9d2', '9170528b-27bb-4328-a258-5c66aedb20a2', '17db1edb-5103-4aba-a784-051a05239a59'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Delete snapshot completed successfully. Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-6c4165d0-caaf-4f3a-99fa-b882671503a4-delete_snapshot" released by "delete_snapshot" :: held 2.800s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-6e823dea-5307-4e14-a9d9-180b6d28847f-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-6e823dea-5307-4e14-a9d9-180b6d28847f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-quobyte-0eae0367-637a-471d-b84f-7716a48a062e" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-0eae0367-637a-471d-b84f-7716a48a062e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-quobyte-6e823dea-5307-4e14-a9d9-180b6d28847f" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-6e823dea-5307-4e14-a9d9-180b6d28847f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Deleting offline snapshot 6e823dea-5307-4e14-a9d9-180b6d28847f of volume 0eae0367-637a-471d-b84f-7716a48a062e {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] snapshot_file for this snap is: volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9497f9-421d-45bf-816b-c0729b15d4ff]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:45 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f Sep 01 01:10:45 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:46 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f" returned: 0 in 0.603s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eae0367-637a-471d-b84f-7716a48a062e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:10:46 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f18197-668a-4e3e-a049-a1ff3c39ab98]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:46 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e Sep 01 01:10:46 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:46 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e" returned: 0 in 0.601s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:46 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f Sep 01 01:10:46 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:47 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f" returned: 0 in 0.572s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:47 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f Sep 01 01:10:47 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:47 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e.6e823dea-5307-4e14-a9d9-180b6d28847f" returned: 0 in 0.325s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-6e823dea-5307-4e14-a9d9-180b6d28847f" released by "_delete_snapshot" :: held 2.310s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-0eae0367-637a-471d-b84f-7716a48a062e" released by "delete_snapshot" :: held 2.354s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:47 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Created reservations ['00c21e5d-b277-46b1-8207-c8f3bc7080cb', 'a504fddb-1278-4575-bb18-e96c4b306c34', '0d232848-3f7c-46db-8284-5af095ee468d', '4b133696-9a5b-413b-8f50-036a84ce9cf1'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:47 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Delete snapshot completed successfully. Sep 01 01:10:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-6e823dea-5307-4e14-a9d9-180b6d28847f-delete_snapshot" released by "delete_snapshot" :: held 2.659s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Snapshots deleted, issuing volume delete {{(pid=87064) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 01:10:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-quobyte-0eae0367-637a-471d-b84f-7716a48a062e" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-0eae0367-637a-471d-b84f-7716a48a062e" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:48 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e716b9d4-7cb5-41bf-8560-f600954fb457]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:48 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e Sep 01 01:10:48 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:48 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e" returned: 0 in 0.556s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:48 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e Sep 01 01:10:48 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:49 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0eae0367-637a-471d-b84f-7716a48a062e" returned: 0 in 0.328s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-0eae0367-637a-471d-b84f-7716a48a062e" released by "delete_volume" :: held 1.068s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Created reservations ['e4a4409e-0350-4f94-9ab2-020dd2cedfa6', 'a9ac0e23-5980-4f50-b1ce-22ec0be5463f', 'd30885a6-6f39-4e4a-b806-2e1c2870663a', '66f8e096-3a6b-4adc-bd66-c4be23681ee2'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:49 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:10:49 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:49 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.483s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:10:49 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Deleted volume successfully. Sep 01 01:10:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d149ae25-1329-4a18-992d-236a1e23e5e8 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-0eae0367-637a-471d-b84f-7716a48a062e-delete_volume" released by "delete_volume" :: held 7.450s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Flow 'volume_create_manager' (85ffaabd-c97d-4cc1-9b57-d3a54edbbea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbee3e0-6413-4358-817a-1479e6b3c106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbee3e0-6413-4358-817a-1479e6b3c106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-307374677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ccff697-1c20-4237-b0a3-ff3ae84569a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a803ad8e79fe46fa8093a8bc2cce000f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:52Z,use_quota=True,user_id='55b3d134f2e7498fbdf5d44c6f58cc69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d907d2-2348-44d5-86f0-faa47116a0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d907d2-2348-44d5-86f0-faa47116a0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b49a41-2729-4dd3-bb8e-665dd2c743bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b49a41-2729-4dd3-bb8e-665dd2c743bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ccff697-1c20-4237-b0a3-ff3ae84569a1', 'volume_name': 'volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006515d6-7738-4df2-bab6-afdd51cefd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006515d6-7738-4df2-bab6-afdd51cefd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466cebca-1dff-4dd1-96ab-9f17660d7ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Volume 0ccff697-1c20-4237-b0a3-ff3ae84569a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1', 'volume_size': 1} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-307374677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ccff697-1c20-4237-b0a3-ff3ae84569a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a803ad8e79fe46fa8093a8bc2cce000f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:52Z,use_quota=True,user_id='55b3d134f2e7498fbdf5d44c6f58cc69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Creating volume 0ccff697-1c20-4237-b0a3-ff3ae84569a1 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:10:52 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:52 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 1073741824 Sep 01 01:10:52 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:52 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:10:52 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:53 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 1073741824" returned: 0 in 1.135s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:53 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 Sep 01 01:10:53 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:53 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.900s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:10:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:10:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:10:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:10:53 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1" returned: 0 in 0.471s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:10:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466cebca-1dff-4dd1-96ab-9f17660d7ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aff4be-cd8f-486f-9c83-e56614d51764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:54 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Volume volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 (0ccff697-1c20-4237-b0a3-ff3ae84569a1): created successfully Sep 01 01:10:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aff4be-cd8f-486f-9c83-e56614d51764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Flow 'volume_create_manager' (85ffaabd-c97d-4cc1-9b57-d3a54edbbea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ca59b174-7bd9-450d-bb67-99629994e1cd tempest-VolumesDeleteCascade-946224966 None] Created volume successfully. Sep 01 01:10:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-abb29660-d3da-4bc2-8be5-92f0e2c4f10e tempest-VolumesActionsTest-2123069200 None] Acquiring lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda" by "attach_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-abb29660-d3da-4bc2-8be5-92f0e2c4f10e tempest-VolumesActionsTest-2123069200 None] Lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda" acquired by "attach_volume" :: waited 0.047s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-abb29660-d3da-4bc2-8be5-92f0e2c4f10e tempest-VolumesActionsTest-2123069200 None] Attaching volume f9a596e6-880c-4577-8ee1-76b925b11eda to instance a05a2f1d-125b-4c1c-9950-d258abec1217 at mountpoint /dev/vdb on host None. Sep 01 01:10:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-abb29660-d3da-4bc2-8be5-92f0e2c4f10e tempest-VolumesActionsTest-2123069200 None] Attach volume completed successfully. Sep 01 01:10:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-abb29660-d3da-4bc2-8be5-92f0e2c4f10e tempest-VolumesActionsTest-2123069200 None] Lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda" released by "attach_volume" :: held 0.172s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ebe372f9-3c2d-4de2-9435-abb397b3fa71 tempest-VolumesActionsTest-2123069200 None] Acquiring lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda-detach_volume" by "detach_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:10:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ebe372f9-3c2d-4de2-9435-abb397b3fa71 tempest-VolumesActionsTest-2123069200 None] Lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:10:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ebe372f9-3c2d-4de2-9435-abb397b3fa71 tempest-VolumesActionsTest-2123069200 None] Detaching volume f9a596e6-880c-4577-8ee1-76b925b11eda from instance a05a2f1d-125b-4c1c-9950-d258abec1217. Sep 01 01:10:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ebe372f9-3c2d-4de2-9435-abb397b3fa71 tempest-VolumesActionsTest-2123069200 None] Detach volume completed successfully. Sep 01 01:10:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ebe372f9-3c2d-4de2-9435-abb397b3fa71 tempest-VolumesActionsTest-2123069200 None] Lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:10:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] Creating offline snapshot 03dac0c0-75ca-4c75-9236-403ca2ac7342 of volume 0ccff697-1c20-4237-b0a3-ff3ae84569a1 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:10:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[37285c95-1906-4ae7-83a5-5ba0c9400b09]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:10:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:56 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 Sep 01 01:10:56 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:56 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1" returned: 0 in 0.732s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:56 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 1G Sep 01 01:10:56 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:57 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 1G" returned: 0 in 0.764s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:57 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 Sep 01 01:10:57 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:57 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342" returned: 0 in 0.472s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:57 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 is being set with open permissions: ugo+rw Sep 01 01:10:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:57 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 Sep 01 01:10:57 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:58 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342" returned: 0 in 0.323s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:58 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.info Sep 01 01:10:58 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:58 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7d2909ef-cc34-413b-8fe2-b68a29cb740f tempest-GroupsTest-1320801619 None] Group tempest-Group1-1695771377: creating Sep 01 01:10:58 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7d2909ef-cc34-413b-8fe2-b68a29cb740f tempest-GroupsTest-1320801619 None] Group tempest-Group1-1695771377: created successfully Sep 01 01:10:58 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7d2909ef-cc34-413b-8fe2-b68a29cb740f tempest-GroupsTest-1320801619 None] Create group completed successfully. Sep 01 01:10:58 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.info" returned: 0 in 0.473s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:58 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.info is being set with open permissions: ugo+rw Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:58 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.info Sep 01 01:10:58 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Flow 'volume_create_manager' (164d4c81-cea2-47ca-925d-03e7f89026af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a53105-89ee-4cb8-824a-6d1f7d494b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a53105-89ee-4cb8-824a-6d1f7d494b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1763297252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6bc106-ffc8-4343-85f7-fa8ef37d59df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298ea058e0a74df3af63320e41102c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:59Z,use_quota=True,user_id='921aa8b248ee412d99c70b287565ee86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:58 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a049250-cf7a-4f0f-ad3c-d27051d8dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a049250-cf7a-4f0f-ad3c-d27051d8dd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5234f1-3760-4892-8b26-01311c5e1f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5234f1-3760-4892-8b26-01311c5e1f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6bc106-ffc8-4343-85f7-fa8ef37d59df', 'volume_name': 'volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad295c0-2338-48bb-b713-05a466c10708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad295c0-2338-48bb-b713-05a466c10708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8dbb4f-9e7a-45b8-83fc-b32275dc5378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:10:58 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Volume ac6bc106-ffc8-4343-85f7-fa8ef37d59df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df', 'volume_size': 1} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.info" returned: 0 in 0.369s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.274s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1763297252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6bc106-ffc8-4343-85f7-fa8ef37d59df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298ea058e0a74df3af63320e41102c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:10:59Z,use_quota=True,user_id='921aa8b248ee412d99c70b287565ee86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Creating volume ac6bc106-ffc8-4343-85f7-fa8ef37d59df {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:10:58 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:10:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:59 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df 1073741824 Sep 01 01:10:59 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a6799a61-c0e1-4fbb-b0be-c92877b825d4 tempest-VolumesDeleteCascade-946224966 None] Create snapshot completed successfully Sep 01 01:10:59 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df 1073741824" returned: 0 in 0.617s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:10:59 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df Sep 01 01:10:59 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:10:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-31823ebe-5810-478a-a024-93e075d620f7 tempest-GroupsTest-1320801619 None] Group tempest-Group2-1885391678: creating Sep 01 01:10:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-31823ebe-5810-478a-a024-93e075d620f7 tempest-GroupsTest-1320801619 None] Group tempest-Group2-1885391678: created successfully Sep 01 01:10:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-31823ebe-5810-478a-a024-93e075d620f7 tempest-GroupsTest-1320801619 None] Create group completed successfully. Sep 01 01:10:59 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 01 01:10:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df" returned: 0 in 0.303s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:10:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:10:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:10:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8dbb4f-9e7a-45b8-83fc-b32275dc5378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:10:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb57514-718b-4c91-aaaf-c053a711c86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:00 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Volume volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df (ac6bc106-ffc8-4343-85f7-fa8ef37d59df): created successfully Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb57514-718b-4c91-aaaf-c053a711c86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Flow 'volume_create_manager' (164d4c81-cea2-47ca-925d-03e7f89026af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:11:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a814fc3e-4734-44da-baf2-8f95f23be3f1 tempest-VolumesServicesTestJSON-1502284619 None] Created volume successfully. Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Flow 'volume_create_manager' (9f34b9c5-c0fd-4653-bfdc-e107955c24f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1522f8cc-9ae2-4d26-9d7b-e487def0484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1522f8cc-9ae2-4d26-9d7b-e487def0484d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1292164977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da5158f-7dbf-4206-89c2-5c76b82d8b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a803ad8e79fe46fa8093a8bc2cce000f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03dac0c0-75ca-4c75-9236-403ca2ac7342,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:11:01Z,use_quota=True,user_id='55b3d134f2e7498fbdf5d44c6f58cc69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73366109-e00d-49d6-9649-354bee7eccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73366109-e00d-49d6-9649-354bee7eccba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c2875f-8c93-458a-89e0-559e3b3cb31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c2875f-8c93-458a-89e0-559e3b3cb31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4da5158f-7dbf-4206-89c2-5c76b82d8b4e', 'volume_name': 'volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e', 'volume_size': 1, 'snapshot_id': '03dac0c0-75ca-4c75-9236-403ca2ac7342'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95f8a72-b4de-4b26-a97e-fa52b37531f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95f8a72-b4de-4b26-a97e-fa52b37531f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b95883-ae55-4562-91b8-e71ffe31ce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:00 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Volume 4da5158f-7dbf-4206-89c2-5c76b82d8b4e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e', 'volume_size': 1, 'snapshot_id': '03dac0c0-75ca-4c75-9236-403ca2ac7342'} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-quobyte-03dac0c0-75ca-4c75-9236-403ca2ac7342-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" by "_create_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-03dac0c0-75ca-4c75-9236-403ca2ac7342-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Creating volume 4da5158f-7dbf-4206-89c2-5c76b82d8b4e from snapshot 03dac0c0-75ca-4c75-9236-403ca2ac7342 {{(pid=87064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-quobyte-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] snapshot: 03dac0c0-75ca-4c75-9236-403ca2ac7342, volume: 4da5158f-7dbf-4206-89c2-5c76b82d8b4e, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f985b1-a409-4307-bf79-71d27dccc4a0]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:01 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 Sep 01 01:11:01 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Acquiring lock "cinder-ac6bc106-ffc8-4343-85f7-fa8ef37d59df-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Lock "cinder-ac6bc106-ffc8-4343-85f7-fa8ef37d59df-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Acquiring lock "cinder-quobyte-ac6bc106-ffc8-4343-85f7-fa8ef37d59df" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Lock "cinder-quobyte-ac6bc106-ffc8-4343-85f7-fa8ef37d59df" acquired by "delete_volume" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2704d135-b699-4a4a-95c9-70408e4a5884]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:01 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df Sep 01 01:11:01 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:01 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342" returned: 0 in 0.702s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:11:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb086ff3-24fe-4155-a980-88287a77b00d]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:01 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 Sep 01 01:11:01 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:11:02 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Flow 'volume_create_manager' (14aa7db6-d0ad-4616-aa8f-dec7a20b86ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa73c427-91aa-4537-88e2-34a09428a029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df" returned: 0 in 0.919s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:02 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df Sep 01 01:11:02 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa73c427-91aa-4537-88e2-34a09428a029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1185312443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8970a9bd-d992-493b-a89c-49f0cd0c1896,host='devstack@QuobyteHD#QuobyteHD',id=5d282b11-c289-4081-8766-f8c58f4edd71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2658474da7840ebaa74ec2694817fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:11:02Z,use_quota=True,user_id='6d87465920dc453ea46357db68e9b5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be6e4ab0-b638-42fd-b36d-f9e95059546c),volume_type_id=be6e4ab0-b638-42fd-b36d-f9e95059546c)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26d99a4-dfa6-40fc-8045-1ffdd7f7ab6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:02 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26d99a4-dfa6-40fc-8045-1ffdd7f7ab6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d948dc3f-fd89-4645-af4b-0001ef41a23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d948dc3f-fd89-4645-af4b-0001ef41a23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d282b11-c289-4081-8766-f8c58f4edd71', 'volume_name': 'volume-5d282b11-c289-4081-8766-f8c58f4edd71', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5656d8-9166-4f3e-bbfe-7852112ec5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5656d8-9166-4f3e-bbfe-7852112ec5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23a2cd7-8192-4da5-9806-1c9aafa2ec2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:02 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Volume 5d282b11-c289-4081-8766-f8c58f4edd71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d282b11-c289-4081-8766-f8c58f4edd71', 'volume_size': 1} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1" returned: 0 in 0.883s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:02 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e Sep 01 01:11:02 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:02 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ac6bc106-ffc8-4343-85f7-fa8ef37d59df" returned: 0 in 0.387s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Lock "cinder-quobyte-ac6bc106-ffc8-4343-85f7-fa8ef37d59df" released by "delete_volume" :: held 1.372s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Created reservations ['a68c838a-270b-4fe1-9da3-90c0a8144653', '5f6eb45d-6801-46de-826f-e15fbe39a212', '0cf3b879-8f5f-4abb-9db3-b92c211df62c', 'ea763e26-b7de-457c-8251-48c69dbf5e39'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:02 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:11:02 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:03 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.408s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:03 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:11:03 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Deleted volume successfully. Sep 01 01:11:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ec03999-6864-42df-b949-7cd5225d823b tempest-VolumesServicesTestJSON-1502284619 None] Lock "cinder-ac6bc106-ffc8-4343-85f7-fa8ef37d59df-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:09 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" returned: 0 in 6.583s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:11:09 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Converted 1024.00 MB image at 155.53 MB/s Sep 01 01:11:09 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e is being set with open permissions: ugo+rw Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:09 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e Sep 01 01:11:09 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:09 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" returned: 0 in 0.363s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" released by "_copy_volume_from_snapshot" :: held 8.695s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-03dac0c0-75ca-4c75-9236-403ca2ac7342-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" released by "_create_volume_from_snapshot" :: held 8.814s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.841s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.080s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8970a9bd-d992-493b-a89c-49f0cd0c1896,created_at=2026-08-31T23:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1185312443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8970a9bd-d992-493b-a89c-49f0cd0c1896,host='devstack@QuobyteHD#QuobyteHD',id=5d282b11-c289-4081-8766-f8c58f4edd71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2658474da7840ebaa74ec2694817fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:11:02Z,use_quota=True,user_id='6d87465920dc453ea46357db68e9b5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be6e4ab0-b638-42fd-b36d-f9e95059546c),volume_type_id=be6e4ab0-b638-42fd-b36d-f9e95059546c)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Creating volume 5d282b11-c289-4081-8766-f8c58f4edd71 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:11:09 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:09 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71 1073741824 Sep 01 01:11:09 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b95883-ae55-4562-91b8-e71ffe31ce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e', 'volume_size': 1, 'snapshot_id': '03dac0c0-75ca-4c75-9236-403ca2ac7342'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d923d4d3-62b6-49b7-927a-9c87e2eedd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:09 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Volume volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e (4da5158f-7dbf-4206-89c2-5c76b82d8b4e): created successfully Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d923d4d3-62b6-49b7-927a-9c87e2eedd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Flow 'volume_create_manager' (9f34b9c5-c0fd-4653-bfdc-e107955c24f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:11:09 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6f4c9f58-e54b-4d80-b2d5-a96bc8091f29 tempest-VolumesDeleteCascade-946224966 None] Created volume successfully. Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-0ccff697-1c20-4237-b0a3-ff3ae84569a1-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-0ccff697-1c20-4237-b0a3-ff3ae84569a1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Performing cascade delete. {{(pid=87064) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-03dac0c0-75ca-4c75-9236-403ca2ac7342-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-03dac0c0-75ca-4c75-9236-403ca2ac7342-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-quobyte-0ccff697-1c20-4237-b0a3-ff3ae84569a1" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-0ccff697-1c20-4237-b0a3-ff3ae84569a1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-quobyte-03dac0c0-75ca-4c75-9236-403ca2ac7342" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-03dac0c0-75ca-4c75-9236-403ca2ac7342" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Deleting offline snapshot 03dac0c0-75ca-4c75-9236-403ca2ac7342 of volume 0ccff697-1c20-4237-b0a3-ff3ae84569a1 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] snapshot_file for this snap is: volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7075c9-a118-4d43-8e8a-b4e85da0d8bf]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:10 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71 1073741824" returned: 0 in 1.104s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:10 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 Sep 01 01:11:10 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:10 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71 Sep 01 01:11:10 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:11 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71" returned: 0 in 0.381s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23a2cd7-8192-4da5-9806-1c9aafa2ec2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d282b11-c289-4081-8766-f8c58f4edd71', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8af1dd3-6210-4f5f-8d41-1df808e1a9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:11 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Volume volume-5d282b11-c289-4081-8766-f8c58f4edd71 (5d282b11-c289-4081-8766-f8c58f4edd71): created successfully Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8af1dd3-6210-4f5f-8d41-1df808e1a9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Flow 'volume_create_manager' (14aa7db6-d0ad-4616-aa8f-dec7a20b86ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:11:11 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342" returned: 0 in 0.651s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:11:11 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b1e33a81-1e10-438b-a4b8-f7b5dca974c6 tempest-GroupsTest-1320801619 None] Created volume successfully. Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4327b13-454d-45ce-acda-6d16ac401fee]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:11 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 Sep 01 01:11:11 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6a7a6a98-dae9-45cb-b6ef-aea2e8a1a854 tempest-VolumesActionsTest-2123069200 None] Acquiring lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda" by "attach_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6a7a6a98-dae9-45cb-b6ef-aea2e8a1a854 tempest-VolumesActionsTest-2123069200 None] Lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda" acquired by "attach_volume" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:12 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6a7a6a98-dae9-45cb-b6ef-aea2e8a1a854 tempest-VolumesActionsTest-2123069200 None] Attaching volume f9a596e6-880c-4577-8ee1-76b925b11eda to instance 4fbc603f-72b8-40a2-9b90-669c49901e48 at mountpoint /dev/vdb on host None. Sep 01 01:11:12 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6a7a6a98-dae9-45cb-b6ef-aea2e8a1a854 tempest-VolumesActionsTest-2123069200 None] Attach volume completed successfully. Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6a7a6a98-dae9-45cb-b6ef-aea2e8a1a854 tempest-VolumesActionsTest-2123069200 None] Lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda" released by "attach_volume" :: held 0.283s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:12 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1" returned: 0 in 0.995s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:12 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 Sep 01 01:11:12 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ac633f03-9222-4d57-8d52-c643fcd8e08a tempest-VolumesActionsTest-2123069200 None] Acquiring lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda-detach_volume" by "detach_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ac633f03-9222-4d57-8d52-c643fcd8e08a tempest-VolumesActionsTest-2123069200 None] Lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:12 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ac633f03-9222-4d57-8d52-c643fcd8e08a tempest-VolumesActionsTest-2123069200 None] Detaching volume f9a596e6-880c-4577-8ee1-76b925b11eda from instance 4fbc603f-72b8-40a2-9b90-669c49901e48. Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:DELETE=7,cinder:SELECT=116,cinder:UPDATE=104,cinder:INSERT=31 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=104,cinder:INSERT=29,cinder:UPDATE=132,cinder:DELETE=11 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:11:12 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ac633f03-9222-4d57-8d52-c643fcd8e08a tempest-VolumesActionsTest-2123069200 None] Detach volume completed successfully. Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ac633f03-9222-4d57-8d52-c643fcd8e08a tempest-VolumesActionsTest-2123069200 None] Lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Acquiring lock "cinder-quobyte-5d282b11-c289-4081-8766-f8c58f4edd71" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Lock "cinder-quobyte-5d282b11-c289-4081-8766-f8c58f4edd71" acquired by "delete_volume" :: waited 0.040s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6c3771-7db4-467d-8cce-6a78478acb7f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:13 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342" returned: 0 in 0.757s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:13 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71 Sep 01 01:11:13 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:13 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342 Sep 01 01:11:13 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:13 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1.03dac0c0-75ca-4c75-9236-403ca2ac7342" returned: 0 in 0.465s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-03dac0c0-75ca-4c75-9236-403ca2ac7342" released by "_delete_snapshot" :: held 3.021s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-0ccff697-1c20-4237-b0a3-ff3ae84569a1" released by "delete_snapshot" :: held 3.061s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:13 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71" returned: 0 in 0.768s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:13 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71 Sep 01 01:11:13 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:13 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Created reservations ['e2bac9a7-9557-4f0c-a76e-bd39a78728b6', '6d3f59a7-7de8-4bb6-90a7-f570ecaa170b', '8fc506a3-1796-48df-8f85-b1f58b858aa2', '75fc2c59-a8ee-481a-be53-f6f9c09f1b13'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:11:13 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Delete snapshot completed successfully. Sep 01 01:11:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-03dac0c0-75ca-4c75-9236-403ca2ac7342-delete_snapshot" released by "delete_snapshot" :: held 3.487s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:13 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Snapshots deleted, issuing volume delete {{(pid=87064) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 01:11:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-quobyte-0ccff697-1c20-4237-b0a3-ff3ae84569a1" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-0ccff697-1c20-4237-b0a3-ff3ae84569a1" acquired by "delete_volume" :: waited 0.030s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[599d2ef1-dbd8-4afe-91ec-17d2078c1666]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:14 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5d282b11-c289-4081-8766-f8c58f4edd71" returned: 0 in 0.386s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Lock "cinder-quobyte-5d282b11-c289-4081-8766-f8c58f4edd71" released by "delete_volume" :: held 1.249s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:14 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 Sep 01 01:11:14 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Created reservations ['34e6e8bc-78f0-476f-8467-14aef5aeb6c6'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:11:14 devstack cinder-volume[87064]: WARNING cinder.quota [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1775897172 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1775897172, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:11:14 devstack cinder-volume[87064]: WARNING cinder.quota [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1775897172 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1775897172, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Created reservations ['ae578ddb-bad7-4b06-8b0c-7da947e397b8', 'ac1af6c3-0aa6-4484-873b-633d8254d02e', '085e6f9b-37ee-4200-8319-1fd4bd562bb6', '19933f70-9852-47c6-a840-430fedf4e0e0'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:11:14 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1" returned: 0 in 0.671s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:14 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1 Sep 01 01:11:14 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:14 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:11:14 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:15 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.421s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:11:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d7db4dcb-b5e7-4665-af58-69dfb54ea457 tempest-GroupsTest-1320801619 None] Delete group completed successfully. Sep 01 01:11:15 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ccff697-1c20-4237-b0a3-ff3ae84569a1" returned: 0 in 0.522s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-0ccff697-1c20-4237-b0a3-ff3ae84569a1" released by "delete_volume" :: held 1.280s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Created reservations ['0eaf32dc-0c75-422e-ae70-daffa7aceb5d', '8c4de142-aa1d-4e5d-945b-29f38d32abf9', '855e294f-5733-43cb-a631-6a6a68c68de6', '7b49a31a-5c5a-4e11-8f30-b1011353a326'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:15 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:11:15 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-e90530d2-a553-4684-b6f1-a5cc6b2def2b tempest-GroupsTest-1320801619 None] Created reservations ['8d89a33e-541a-4435-8ee7-6cf897fcb6fb'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:11:15 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.359s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:11:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Deleted volume successfully. Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-31e81fed-9ac5-4ec5-8b95-a8e9ed4d95f6 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-0ccff697-1c20-4237-b0a3-ff3ae84569a1-delete_volume" released by "delete_volume" :: held 5.508s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e90530d2-a553-4684-b6f1-a5cc6b2def2b tempest-GroupsTest-1320801619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e90530d2-a553-4684-b6f1-a5cc6b2def2b tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e90530d2-a553-4684-b6f1-a5cc6b2def2b tempest-GroupsTest-1320801619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e90530d2-a553-4684-b6f1-a5cc6b2def2b tempest-GroupsTest-1320801619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e90530d2-a553-4684-b6f1-a5cc6b2def2b tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e90530d2-a553-4684-b6f1-a5cc6b2def2b tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:15 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:11:15 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:16 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e90530d2-a553-4684-b6f1-a5cc6b2def2b tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.349s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:16 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-e90530d2-a553-4684-b6f1-a5cc6b2def2b tempest-GroupsTest-1320801619 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:11:16 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e90530d2-a553-4684-b6f1-a5cc6b2def2b tempest-GroupsTest-1320801619 None] Delete group completed successfully. Sep 01 01:11:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-4da5158f-7dbf-4206-89c2-5c76b82d8b4e-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-4da5158f-7dbf-4206-89c2-5c76b82d8b4e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "cinder-quobyte-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:16 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d651cd4f-89de-41d1-b31c-5b8050bd4639]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:16 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e Sep 01 01:11:16 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:17 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" returned: 0 in 0.457s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:17 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e Sep 01 01:11:17 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:17 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" returned: 0 in 0.469s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-quobyte-4da5158f-7dbf-4206-89c2-5c76b82d8b4e" released by "delete_volume" :: held 1.014s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:17 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-59a2f605-08db-461a-81c0-837d57ca7020 tempest-GroupsTest-1320801619 None] Group tempest-GroupsTest-Group-550637921: creating Sep 01 01:11:17 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-59a2f605-08db-461a-81c0-837d57ca7020 tempest-GroupsTest-1320801619 None] Group tempest-GroupsTest-Group-550637921: created successfully Sep 01 01:11:17 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Created reservations ['f8ae2a7f-bda6-4b66-8738-0f57e3a5e955', '112d25c0-839d-4cf6-9ed3-01667dd8da02', '9902ba00-ea36-4819-b498-a03cbd58c1e5', '3bf35036-17f9-4942-8258-e0cd4947475a'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:11:17 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-59a2f605-08db-461a-81c0-837d57ca7020 tempest-GroupsTest-1320801619 None] Create group completed successfully. Sep 01 01:11:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:17 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:11:17 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:18 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.265s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:18 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:11:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Deleted volume successfully. Sep 01 01:11:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ee4306fa-f264-4440-8d08-11c7b4f61077 tempest-VolumesDeleteCascade-946224966 None] Lock "cinder-4da5158f-7dbf-4206-89c2-5c76b82d8b4e-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:18 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab74d0a-1e48-4081-bc14-180fd7a9cc92]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:18 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda Sep 01 01:11:18 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:18 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda" returned: 0 in 0.522s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:18 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d43d6cd-dee4-49d1-8739-b7bcd2b60594]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:19 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda Sep 01 01:11:19 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:19 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda" returned: 0 in 0.662s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.ab06ae68-6db8-4c80-b952-0b37dbee866agdnjwdwa.img {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:19 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.ab06ae68-6db8-4c80-b952-0b37dbee866agdnjwdwa.img Sep 01 01:11:19 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Flow 'volume_create_manager' (b2c3848c-4d78-4cd0-b8a2-24172aa55628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70d82c9-c4e5-4c2f-9941-b9a77f8315b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70d82c9-c4e5-4c2f-9941-b9a77f8315b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2073615232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca43a9e8-f899-4d72-be97-9b949eaba5eb,host='devstack@QuobyteHD#QuobyteHD',id=d3d74f35-3963-47d1-9ddb-25ae92ebe33e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2658474da7840ebaa74ec2694817fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:11:20Z,use_quota=True,user_id='6d87465920dc453ea46357db68e9b5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(997027b2-ea14-4bbe-a3a5-70f16c51bbc1),volume_type_id=997027b2-ea14-4bbe-a3a5-70f16c51bbc1)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c3b607-4d54-402b-b6c0-78e8f221e2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c3b607-4d54-402b-b6c0-78e8f221e2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a2f624-83ba-45d2-a282-b38ddd5697fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a2f624-83ba-45d2-a282-b38ddd5697fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3d74f35-3963-47d1-9ddb-25ae92ebe33e', 'volume_name': 'volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6f7cdd-8624-4095-b56d-ea4341d522f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6f7cdd-8624-4095-b56d-ea4341d522f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706e0463-e818-41de-b649-9bd56ee98539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:19 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Volume d3d74f35-3963-47d1-9ddb-25ae92ebe33e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e', 'volume_size': 1} Sep 01 01:11:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:24 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.ab06ae68-6db8-4c80-b952-0b37dbee866agdnjwdwa.img" returned: 0 in 5.214s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:24 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c270149c-1140-4d64-a15d-56851ac564ef]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:25 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda Sep 01 01:11:25 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:25 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda" returned: 0 in 0.604s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:25 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.ab06ae68-6db8-4c80-b952-0b37dbee866agdnjwdwa.img {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:11:25 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] Converted 1024.00 MB image at 196.28 MB/s Sep 01 01:11:25 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] ab06ae68-6db8-4c80-b952-0b37dbee866a was raw, no need to convert to raw {{(pid=87064) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 01:11:27 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:11:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Flow 'volume_create_manager' (0147ab1e-ba2f-4241-8a86-57a40d67b1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:11:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361f3f78-4165-46f5-ae2d-70d39330fede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361f3f78-4165-46f5-ae2d-70d39330fede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1693152157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db15df5e24e43d4a29f59aa535a81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:11:28Z,use_quota=True,user_id='b57d99a7e92444e9876df5ad41bc9aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a92d109-f82b-49f6-af91-84b982115528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a92d109-f82b-49f6-af91-84b982115528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc19ce9a-acdc-42d4-9436-0af399787885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc19ce9a-acdc-42d4-9436-0af399787885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc', 'volume_name': 'volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acd78db-b3eb-4f22-83fc-4f6e83893278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acd78db-b3eb-4f22-83fc-4f6e83893278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5054fbc6-17c7-4aa8-a21d-6a9cdcb949d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:28 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Volume 1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc', 'volume_size': 1} Sep 01 01:11:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:37 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=42,cinder:SELECT=37,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:11:42 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=32,cinder:INSERT=11,cinder:UPDATE=34 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.956s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] Uploaded volume to glance image-id: ab06ae68-6db8-4c80-b952-0b37dbee866a. {{(pid=87064) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.474s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca43a9e8-f899-4d72-be97-9b949eaba5eb,created_at=2026-08-31T23:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2073615232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca43a9e8-f899-4d72-be97-9b949eaba5eb,host='devstack@QuobyteHD#QuobyteHD',id=d3d74f35-3963-47d1-9ddb-25ae92ebe33e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2658474da7840ebaa74ec2694817fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:11:20Z,use_quota=True,user_id='6d87465920dc453ea46357db68e9b5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(997027b2-ea14-4bbe-a3a5-70f16c51bbc1),volume_type_id=997027b2-ea14-4bbe-a3a5-70f16c51bbc1)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Creating volume d3d74f35-3963-47d1-9ddb-25ae92ebe33e {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:11:50 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:50 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-bdaa9d23-bf95-4cb8-aed0-bf2145056093 tempest-VolumesActionsTest-2123069200 None] Copy volume to image completed successfully. Sep 01 01:11:50 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e 1073741824 Sep 01 01:11:50 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:50 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e 1073741824" returned: 0 in 0.499s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:50 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e Sep 01 01:11:50 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:51 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e" returned: 0 in 0.273s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.097s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1693152157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db15df5e24e43d4a29f59aa535a81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:11:28Z,use_quota=True,user_id='b57d99a7e92444e9876df5ad41bc9aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Creating volume 1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:11:51 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706e0463-e818-41de-b649-9bd56ee98539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dbdf71-5a9c-433a-b670-b962c7db7a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:51 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc 1073741824 Sep 01 01:11:51 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:51 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Volume volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e (d3d74f35-3963-47d1-9ddb-25ae92ebe33e): created successfully Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dbdf71-5a9c-433a-b670-b962c7db7a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Flow 'volume_create_manager' (b2c3848c-4d78-4cd0-b8a2-24172aa55628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:11:51 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-764fedb1-d4ab-4851-8f6b-967fbd6eac18 tempest-GroupsTest-1320801619 None] Created volume successfully. Sep 01 01:11:51 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc 1073741824" returned: 0 in 0.603s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:51 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc Sep 01 01:11:51 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:52 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc" returned: 0 in 0.302s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5054fbc6-17c7-4aa8-a21d-6a9cdcb949d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d49787a-187e-4669-82a8-4c81dec910ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Volume volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc (1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc): created successfully Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d49787a-187e-4669-82a8-4c81dec910ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Flow 'volume_create_manager' (0147ab1e-ba2f-4241-8a86-57a40d67b1ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:11:52 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-68b4b518-a2e2-41b5-b402-5020add883db tempest-VolumesTransfersV357Test-1787492355 None] Created volume successfully. Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9386ac6b-6615-45c0-891c-a363e0c1d999]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:52 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda Sep 01 01:11:52 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:52 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:11:52 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:53 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda" returned: 0 in 0.593s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[10edfa70-8859-4274-9583-1f2ccc78e743]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:53 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.400s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:11:53 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda Sep 01 01:11:53 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:53 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda" returned: 0 in 0.711s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:53 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img Sep 01 01:11:53 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Flow 'volume_create_manager' (1dfc8580-f7c4-468b-b81f-7fe8a23dca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156f335c-a520-49e6-9300-3a3dfa44daa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156f335c-a520-49e6-9300-3a3dfa44daa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708878247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca43a9e8-f899-4d72-be97-9b949eaba5eb,host='devstack@QuobyteHD#QuobyteHD',id=ce72767a-ff88-4812-bf20-d52ca5ece74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2658474da7840ebaa74ec2694817fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:11:54Z,use_quota=True,user_id='6d87465920dc453ea46357db68e9b5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(997027b2-ea14-4bbe-a3a5-70f16c51bbc1),volume_type_id=997027b2-ea14-4bbe-a3a5-70f16c51bbc1)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ef7a1f-44be-47ee-a663-bcdfbdc45381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ef7a1f-44be-47ee-a663-bcdfbdc45381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9654e9d2-3bbe-4166-8eb1-82c4490cac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9654e9d2-3bbe-4166-8eb1-82c4490cac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce72767a-ff88-4812-bf20-d52ca5ece74e', 'volume_name': 'volume-ce72767a-ff88-4812-bf20-d52ca5ece74e', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad18770-a530-47d3-a204-d6de2364eef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad18770-a530-47d3-a204-d6de2364eef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:11:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6591db-2d05-4c23-9aef-2ae00fd6cea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:11:54 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Volume ce72767a-ff88-4812-bf20-d52ca5ece74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce72767a-ff88-4812-bf20-d52ca5ece74e', 'volume_size': 1} Sep 01 01:11:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a602c837-c73a-4a93-af63-0846aa79005b tempest-VolumesTransfersV357Test-1828672674 None] Transfer volume completed successfully. Sep 01 01:11:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Acquiring lock "cinder-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Lock "cinder-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Acquiring lock "cinder-quobyte-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:11:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Lock "cinder-quobyte-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc" acquired by "delete_volume" :: waited 0.046s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:11:57 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf45963-012e-48a2-9e0c-0eeb896b0381]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:58 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc Sep 01 01:11:58 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:59 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc" returned: 0 in 1.225s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:59 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc Sep 01 01:11:59 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:59 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc" returned: 0 in 0.622s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:59 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img" returned: 0 in 5.903s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Lock "cinder-quobyte-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc" released by "delete_volume" :: held 1.946s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[855e8ed5-11e1-4edd-9163-d0b050b53741]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Created reservations ['6a312a3c-32e6-4198-9190-e4d599441346', 'e8ae3e87-4dac-4083-b63d-0cecc79951b8', '3e4edbfa-f507-440e-8df2-8bef2fe78cbb', '2ae562e4-778b-406b-9b2c-1418862cb6ba'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:11:59 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda Sep 01 01:11:59 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:11:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:11:59 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:11:59 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:00 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.332s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:00 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Deleted volume successfully. Sep 01 01:12:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-efacd86f-173e-453d-b0ed-45bfe8105b56 tempest-VolumesTransfersV357Test-1369210181 None] Lock "cinder-1a57ef14-bf40-48f1-b4ff-662ba3ca9dfc-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:00 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda" returned: 0 in 0.799s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:00 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:12:00 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Converted 1024.00 MB image at 173.39 MB/s Sep 01 01:12:00 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] 37e53407-3f05-4423-8377-4787ea703222 was raw, converting to qcow2 {{(pid=87064) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 01:12:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ba3941-6935-4647-a699-ff0afb912f9b]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:00 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img Sep 01 01:12:00 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:00 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:12:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Flow 'volume_create_manager' (b8961d97-bf52-487b-b502-a01101705e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3584ccde-f92e-4a19-9079-846528c2c579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3584ccde-f92e-4a19-9079-846528c2c579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-843516439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027afd6f-4e99-49bc-becc-d533a891f481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db15df5e24e43d4a29f59aa535a81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:01Z,use_quota=True,user_id='b57d99a7e92444e9876df5ad41bc9aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0028bde3-30ec-4c80-b1ab-d17ac98e0cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0028bde3-30ec-4c80-b1ab-d17ac98e0cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aaf15e0-b36a-4bcf-842a-f772b920cde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aaf15e0-b36a-4bcf-842a-f772b920cde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027afd6f-4e99-49bc-becc-d533a891f481', 'volume_name': 'volume-027afd6f-4e99-49bc-becc-d533a891f481', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b881a387-b4b6-4210-ade9-6eb668d65a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b881a387-b4b6-4210-ade9-6eb668d65a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4657f3cf-b036-41f1-a4be-f62bb759ac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:01 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Volume 027afd6f-4e99-49bc-becc-d533a891f481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027afd6f-4e99-49bc-becc-d533a891f481', 'volume_size': 1} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:01 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img" returned: 0 in 0.562s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:01 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img Sep 01 01:12:01 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:01 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img" returned: 1 in 0.403s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img /opt/stack/data/cinder/conversion/vol_upload_vv73ryqq {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:01 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img /opt/stack/data/cinder/conversion/vol_upload_vv73ryqq Sep 01 01:12:01 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:01 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img /opt/stack/data/cinder/conversion/vol_upload_vv73ryqq" returned: 0 in 0.293s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Image conversion details: src /opt/stack/data/cinder/conversion/f9a596e6-880c-4577-8ee1-76b925b11eda.temp_image.37e53407-3f05-4423-8377-4787ea703222dik79oai.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_vv73ryqq {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:12:01 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad85d95c-81b0-47a7-8e4e-d18dd574fddd]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vv73ryqq {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:01 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vv73ryqq Sep 01 01:12:01 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:02 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vv73ryqq" returned: 0 in 0.408s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.551s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Uploaded volume to glance image-id: 37e53407-3f05-4423-8377-4787ea703222. {{(pid=87064) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.017s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca43a9e8-f899-4d72-be97-9b949eaba5eb,created_at=2026-08-31T23:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708878247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca43a9e8-f899-4d72-be97-9b949eaba5eb,host='devstack@QuobyteHD#QuobyteHD',id=ce72767a-ff88-4812-bf20-d52ca5ece74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2658474da7840ebaa74ec2694817fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:11:54Z,use_quota=True,user_id='6d87465920dc453ea46357db68e9b5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(997027b2-ea14-4bbe-a3a5-70f16c51bbc1),volume_type_id=997027b2-ea14-4bbe-a3a5-70f16c51bbc1)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Creating volume ce72767a-ff88-4812-bf20-d52ca5ece74e {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:04 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:04 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e 1073741824 Sep 01 01:12:04 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:04 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0f75f716-4330-495f-bba2-4a9ad8a8cf00 tempest-VolumesActionsTest-2123069200 None] Copy volume to image completed successfully. Sep 01 01:12:04 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e 1073741824" returned: 0 in 0.841s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:04 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e Sep 01 01:12:04 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:05 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e" returned: 0 in 0.331s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.146s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-843516439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027afd6f-4e99-49bc-becc-d533a891f481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db15df5e24e43d4a29f59aa535a81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:01Z,use_quota=True,user_id='b57d99a7e92444e9876df5ad41bc9aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Creating volume 027afd6f-4e99-49bc-becc-d533a891f481 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:05 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:05 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481 1073741824 Sep 01 01:12:05 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6591db-2d05-4c23-9aef-2ae00fd6cea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce72767a-ff88-4812-bf20-d52ca5ece74e', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf8d0dc-f7fc-4db5-bd54-eb6ef3d8cc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:05 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Volume volume-ce72767a-ff88-4812-bf20-d52ca5ece74e (ce72767a-ff88-4812-bf20-d52ca5ece74e): created successfully Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf8d0dc-f7fc-4db5-bd54-eb6ef3d8cc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Flow 'volume_create_manager' (1dfc8580-f7c4-468b-b81f-7fe8a23dca55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:05 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f0562786-fb11-4075-8424-ae408bfb7751 tempest-GroupsTest-1320801619 None] Created volume successfully. Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Acquiring lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Acquiring lock "cinder-quobyte-f9a596e6-880c-4577-8ee1-76b925b11eda" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Lock "cinder-quobyte-f9a596e6-880c-4577-8ee1-76b925b11eda" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efc6a29-9ef7-40ba-82e5-eeee7be78ce0]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:05 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda Sep 01 01:12:05 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:05 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481 1073741824" returned: 0 in 0.579s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:05 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481 Sep 01 01:12:05 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5f286d0e-f9d6-47e3-9923-cb3159a48326 tempest-GroupsTest-1320801619 None] Update group completed successfully. Sep 01 01:12:06 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda" returned: 0 in 0.526s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:06 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda Sep 01 01:12:06 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:06 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481" returned: 0 in 0.332s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4657f3cf-b036-41f1-a4be-f62bb759ac5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027afd6f-4e99-49bc-becc-d533a891f481', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e348a7-20a4-4c1e-bb98-f0802102b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:06 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Volume volume-027afd6f-4e99-49bc-becc-d533a891f481 (027afd6f-4e99-49bc-becc-d533a891f481): created successfully Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e348a7-20a4-4c1e-bb98-f0802102b897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Flow 'volume_create_manager' (b8961d97-bf52-487b-b502-a01101705e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5c8f6bc3-ac65-4e04-97da-65e48d1241f4 tempest-VolumesTransfersV357Test-1787492355 None] Created volume successfully. Sep 01 01:12:06 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f9a596e6-880c-4577-8ee1-76b925b11eda" returned: 0 in 0.399s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Lock "cinder-quobyte-f9a596e6-880c-4577-8ee1-76b925b11eda" released by "delete_volume" :: held 0.977s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Created reservations ['12513370-521b-4193-91f5-9b934539fc8f', '7ef4e265-d600-487f-827b-2e4570776200', 'c7d1d5d8-5dca-4127-affc-8ed677a2d71a', '8b86969a-6b64-42c6-8d1f-7ca786997c54'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:06 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:06 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:07 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.319s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:07 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:07 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Deleted volume successfully. Sep 01 01:12:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3fa9b6b7-a38f-42d4-a663-b32a4e61ab01 tempest-VolumesActionsTest-2123069200 None] Lock "cinder-f9a596e6-880c-4577-8ee1-76b925b11eda-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:07 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-710644ca-c42e-4493-bd76-775cacd69c28 tempest-GroupsTest-1320801619 None] Update group completed successfully. Sep 01 01:12:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Acquiring lock "cinder-027afd6f-4e99-49bc-becc-d533a891f481-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Lock "cinder-027afd6f-4e99-49bc-becc-d533a891f481-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Acquiring lock "cinder-quobyte-027afd6f-4e99-49bc-becc-d533a891f481" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Lock "cinder-quobyte-027afd6f-4e99-49bc-becc-d533a891f481" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:08 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d55acf-670e-4c1e-95c9-4ad9be9cd413]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:08 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481 Sep 01 01:12:08 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:08 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481" returned: 0 in 0.542s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:08 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481 Sep 01 01:12:08 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:09 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-027afd6f-4e99-49bc-becc-d533a891f481" returned: 0 in 0.425s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Lock "cinder-quobyte-027afd6f-4e99-49bc-becc-d533a891f481" released by "delete_volume" :: held 1.070s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Created reservations ['13953af5-04ab-407f-bd0f-8af23068a46d', '898136d3-f5fd-4d7b-9f53-253195fad938', 'caa1cdc4-6edf-47de-99fd-32e3b5cd0e67', 'e4802738-42b2-47a2-a5c4-c9946e8a9310'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:09 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:09 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Acquiring lock "cinder-quobyte-ce72767a-ff88-4812-bf20-d52ca5ece74e" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Lock "cinder-quobyte-ce72767a-ff88-4812-bf20-d52ca5ece74e" acquired by "delete_volume" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e13e88-5a6c-4884-bead-2746212ef239]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:10 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e Sep 01 01:12:10 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:10 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.632s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:10 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:10 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Deleted volume successfully. Sep 01 01:12:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-beaba6a3-901c-4780-b338-0d2dce85ad89 tempest-VolumesTransfersV357Test-1369210181 None] Lock "cinder-027afd6f-4e99-49bc-becc-d533a891f481-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:10 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e" returned: 0 in 0.619s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:10 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e Sep 01 01:12:10 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:10 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ce72767a-ff88-4812-bf20-d52ca5ece74e" returned: 0 in 0.351s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Lock "cinder-quobyte-ce72767a-ff88-4812-bf20-d52ca5ece74e" released by "delete_volume" :: held 1.040s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Acquiring lock "cinder-quobyte-d3d74f35-3963-47d1-9ddb-25ae92ebe33e" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Lock "cinder-quobyte-d3d74f35-3963-47d1-9ddb-25ae92ebe33e" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:10 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[64756dc1-5cdd-4bae-bc76-8193d82d644d]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:11 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e Sep 01 01:12:11 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:11 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e" returned: 0 in 0.595s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:11 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e Sep 01 01:12:11 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:11 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d3d74f35-3963-47d1-9ddb-25ae92ebe33e" returned: 0 in 0.376s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Lock "cinder-quobyte-d3d74f35-3963-47d1-9ddb-25ae92ebe33e" released by "delete_volume" :: held 1.045s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:12 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Created reservations ['10538bf7-b472-42c5-a863-026784441205'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:12 devstack cinder-volume[87064]: WARNING cinder.quota [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1420379323 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1420379323, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:12:12 devstack cinder-volume[87064]: WARNING cinder.quota [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1420379323 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1420379323, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:12:12 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Created reservations ['39e780bd-1810-42ea-af6b-abd30fa0e2d4', 'c084ec60-189b-4e22-a0bf-19ab06d64288', '18399b42-f804-4d42-86ab-c4d94e908c2c', '923b670c-186b-4859-a9ce-f4eefa65d662'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:12 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Created reservations ['018b88a7-81d1-419c-b5c4-0662d3c56fc2', '1cace381-3fca-4fbc-9532-6febc07922d4', '760e91ff-6e55-4ecb-8ef0-0da21029a603', 'f03a25b4-17b8-43f1-8106-0af38d139beb'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:12 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:12 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:13 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.434s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:13 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:13 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-dc1d1ba7-129c-4009-b788-e27f1005ca59 tempest-GroupsTest-1320801619 None] Delete group completed successfully. Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (5691850b-95fa-4942-9c96-d519535b7462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6af539-7474-48e2-880f-04df6360a08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6af539-7474-48e2-880f-04df6360a08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1865286847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c372036f-edef-4306-91c5-1c02a7b45fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:19Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceb5a82-6a46-422c-88d8-81d950956e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceb5a82-6a46-422c-88d8-81d950956e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef834668-bef3-416f-8974-1810af890227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef834668-bef3-416f-8974-1810af890227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c372036f-edef-4306-91c5-1c02a7b45fff', 'volume_name': 'volume-c372036f-edef-4306-91c5-1c02a7b45fff', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f929a58c-1353-4bde-83de-19b5fbcd5079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f929a58c-1353-4bde-83de-19b5fbcd5079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0986a1c6-9321-4e3c-b845-2a737fd1cc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:18 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Volume c372036f-edef-4306-91c5-1c02a7b45fff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c372036f-edef-4306-91c5-1c02a7b45fff', 'volume_size': 1} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1865286847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c372036f-edef-4306-91c5-1c02a7b45fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:19Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Creating volume c372036f-edef-4306-91c5-1c02a7b45fff {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:18 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:18 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff 1073741824 Sep 01 01:12:18 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:20 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff 1073741824" returned: 0 in 1.172s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:20 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff Sep 01 01:12:20 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:20 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff" returned: 0 in 0.481s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0986a1c6-9321-4e3c-b845-2a737fd1cc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c372036f-edef-4306-91c5-1c02a7b45fff', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ccf001-e36f-46c2-ba55-de1aaf7917ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:20 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Volume volume-c372036f-edef-4306-91c5-1c02a7b45fff (c372036f-edef-4306-91c5-1c02a7b45fff): created successfully Sep 01 01:12:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ccf001-e36f-46c2-ba55-de1aaf7917ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (5691850b-95fa-4942-9c96-d519535b7462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:20 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-fa756820-0747-47b1-9890-83b538ea085b tempest-VolumesActionsTest-1040308440 None] Created volume successfully. Sep 01 01:12:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-acf95a14-65e8-4eda-9789-0bc5f1a40f11 tempest-VolumesActionsTest-1040308440 None] Acquiring lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff" by "attach_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-acf95a14-65e8-4eda-9789-0bc5f1a40f11 tempest-VolumesActionsTest-1040308440 None] Lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff" acquired by "attach_volume" :: waited 0.039s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-acf95a14-65e8-4eda-9789-0bc5f1a40f11 tempest-VolumesActionsTest-1040308440 None] Attaching volume c372036f-edef-4306-91c5-1c02a7b45fff to instance 6556e9a7-8379-4809-a301-f5530a803faf at mountpoint /dev/vdb on host None. Sep 01 01:12:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-acf95a14-65e8-4eda-9789-0bc5f1a40f11 tempest-VolumesActionsTest-1040308440 None] Attach volume completed successfully. Sep 01 01:12:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-acf95a14-65e8-4eda-9789-0bc5f1a40f11 tempest-VolumesActionsTest-1040308440 None] Lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff" released by "attach_volume" :: held 0.179s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:22 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-feb03fd4-69e9-43ba-a041-4208b58abec4 tempest-VolumesActionsTest-1956640073 None] Terminate volume connection completed successfully. Sep 01 01:12:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-feb03fd4-69e9-43ba-a041-4208b58abec4 tempest-VolumesActionsTest-1956640073 None] Acquiring lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff-detach_volume" by "detach_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-feb03fd4-69e9-43ba-a041-4208b58abec4 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:22 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-feb03fd4-69e9-43ba-a041-4208b58abec4 tempest-VolumesActionsTest-1956640073 None] Detaching volume c372036f-edef-4306-91c5-1c02a7b45fff from instance 6556e9a7-8379-4809-a301-f5530a803faf. Sep 01 01:12:23 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-feb03fd4-69e9-43ba-a041-4208b58abec4 tempest-VolumesActionsTest-1956640073 None] Detach volume completed successfully. Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-feb03fd4-69e9-43ba-a041-4208b58abec4 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff-detach_volume" released by "detach_volume" :: held 0.214s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Flow 'volume_create_manager' (ed6b336c-a7f5-47f6-bcf9-dc5670d71874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b12330f-93bb-4c7c-a275-ef495778dc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b12330f-93bb-4c7c-a275-ef495778dc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1153076996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357c7bf1-d081-4ef0-99f0-cffa9ecae8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3ef3fabe5640f596217d49a643868d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:23Z,use_quota=True,user_id='e0489253ab924454a3d5eeeb55dda9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034405d1-7977-48ad-b714-0e98091e2e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034405d1-7977-48ad-b714-0e98091e2e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e566255b-4e78-4455-aff7-a3574afed71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e566255b-4e78-4455-aff7-a3574afed71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '357c7bf1-d081-4ef0-99f0-cffa9ecae8db', 'volume_name': 'volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db', 'volume_size': 2}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d41caac-3eac-4616-b02a-7cd8278d9c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d41caac-3eac-4616-b02a-7cd8278d9c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7980cded-71cd-4157-a5d7-23793ab64edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:23 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Volume 357c7bf1-d081-4ef0-99f0-cffa9ecae8db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db', 'volume_size': 2} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1153076996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357c7bf1-d081-4ef0-99f0-cffa9ecae8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3ef3fabe5640f596217d49a643868d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:23Z,use_quota=True,user_id='e0489253ab924454a3d5eeeb55dda9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Creating volume 357c7bf1-d081-4ef0-99f0-cffa9ecae8db {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:23 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db 2147483648 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:23 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db 2147483648 Sep 01 01:12:23 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fe85f698-ef74-4745-97a6-02d30471a0ff tempest-VolumesActionsTest-1040308440 None] Acquiring lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff-detach_volume" by "detach_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fe85f698-ef74-4745-97a6-02d30471a0ff tempest-VolumesActionsTest-1040308440 None] Lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:23 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-fe85f698-ef74-4745-97a6-02d30471a0ff tempest-VolumesActionsTest-1040308440 None] Volume detach called, but volume not attached. Sep 01 01:12:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fe85f698-ef74-4745-97a6-02d30471a0ff tempest-VolumesActionsTest-1040308440 None] Lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Acquiring lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Acquiring lock "cinder-quobyte-c372036f-edef-4306-91c5-1c02a7b45fff" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Lock "cinder-quobyte-c372036f-edef-4306-91c5-1c02a7b45fff" acquired by "delete_volume" :: waited 0.040s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:24 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[490a666c-f870-4a6a-aba4-bd60fd668171]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:24 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff Sep 01 01:12:24 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:24 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db 2147483648" returned: 0 in 1.252s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:24 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db Sep 01 01:12:24 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:25 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff" returned: 0 in 0.888s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:25 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff Sep 01 01:12:25 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:25 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db" returned: 0 in 0.580s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7980cded-71cd-4157-a5d7-23793ab64edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db', 'volume_size': 2}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5355935-f825-4839-912e-94af9356bbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:25 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Volume volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db (357c7bf1-d081-4ef0-99f0-cffa9ecae8db): created successfully Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5355935-f825-4839-912e-94af9356bbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Flow 'volume_create_manager' (ed6b336c-a7f5-47f6-bcf9-dc5670d71874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:25 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9db5f4ed-3feb-4a1e-a679-d773693b7fb4 tempest-VolumesCloneNegativeTest-599963767 None] Created volume successfully. Sep 01 01:12:25 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c372036f-edef-4306-91c5-1c02a7b45fff" returned: 0 in 0.590s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Lock "cinder-quobyte-c372036f-edef-4306-91c5-1c02a7b45fff" released by "delete_volume" :: held 1.555s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:25 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Created reservations ['bac70708-04b8-4d0e-9836-4a1191d8f84d', '95e7f625-60f1-4725-9aef-02016aedbee6', '2f54b041-bb14-4b03-bf49-2ae8fb26a96b', '59f35970-8f34-4b6b-92de-5da76fde17f3'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:26 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:26 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:26 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-257ef96b-2e71-4362-8422-db8bce8ffd0a tempest-GroupsV320Test-2016003107 None] Group tempest-GroupsV320Test-Group-35539472: creating Sep 01 01:12:26 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.503s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:26 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:26 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Deleted volume successfully. Sep 01 01:12:26 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-257ef96b-2e71-4362-8422-db8bce8ffd0a tempest-GroupsV320Test-2016003107 None] Group tempest-GroupsV320Test-Group-35539472: created successfully Sep 01 01:12:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cd7286e7-7af0-4ae8-b8ab-ac70859b1e81 tempest-VolumesActionsTest-1040308440 None] Lock "cinder-c372036f-edef-4306-91c5-1c02a7b45fff-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:26 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-257ef96b-2e71-4362-8422-db8bce8ffd0a tempest-GroupsV320Test-2016003107 None] Create group completed successfully. Sep 01 01:12:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Acquiring lock "cinder-357c7bf1-d081-4ef0-99f0-cffa9ecae8db-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Lock "cinder-357c7bf1-d081-4ef0-99f0-cffa9ecae8db-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Acquiring lock "cinder-quobyte-357c7bf1-d081-4ef0-99f0-cffa9ecae8db" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Lock "cinder-quobyte-357c7bf1-d081-4ef0-99f0-cffa9ecae8db" acquired by "delete_volume" :: waited 0.046s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:27 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[685f0561-4921-4957-a348-3bc1e0469dbb]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:27 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db Sep 01 01:12:27 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:28 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db" returned: 0 in 1.151s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:28 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db Sep 01 01:12:28 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:28 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-89c0e5d0-6119-4808-8910-231b86c5d08c tempest-GroupsV320Test-2016003107 None] Created reservations ['bc7098ec-9c07-421b-a06c-74f33c7cff5c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-89c0e5d0-6119-4808-8910-231b86c5d08c tempest-GroupsV320Test-2016003107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-89c0e5d0-6119-4808-8910-231b86c5d08c tempest-GroupsV320Test-2016003107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-89c0e5d0-6119-4808-8910-231b86c5d08c tempest-GroupsV320Test-2016003107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-89c0e5d0-6119-4808-8910-231b86c5d08c tempest-GroupsV320Test-2016003107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-89c0e5d0-6119-4808-8910-231b86c5d08c tempest-GroupsV320Test-2016003107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-89c0e5d0-6119-4808-8910-231b86c5d08c tempest-GroupsV320Test-2016003107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:29 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-357c7bf1-d081-4ef0-99f0-cffa9ecae8db" returned: 0 in 0.489s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:29 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:29 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Lock "cinder-quobyte-357c7bf1-d081-4ef0-99f0-cffa9ecae8db" released by "delete_volume" :: held 1.804s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Created reservations ['58450b8b-5979-4cd1-9a48-036abc40cff5', '522c5c0a-5e6d-440c-8808-ea9db8c52aea', 'aff0f01c-b97c-4feb-93da-a792324e75cd', 'e32d1eaf-e1f2-4f5b-89b3-8071bbc10898'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:29 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:29 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:29 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-89c0e5d0-6119-4808-8910-231b86c5d08c tempest-GroupsV320Test-2016003107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.486s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-89c0e5d0-6119-4808-8910-231b86c5d08c tempest-GroupsV320Test-2016003107 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:29 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-89c0e5d0-6119-4808-8910-231b86c5d08c tempest-GroupsV320Test-2016003107 None] Delete group completed successfully. Sep 01 01:12:29 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.539s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:29 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Deleted volume successfully. Sep 01 01:12:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c9bfda9c-c29b-40dc-907c-bdd8a77963f9 tempest-VolumesCloneNegativeTest-599963767 None] Lock "cinder-357c7bf1-d081-4ef0-99f0-cffa9ecae8db-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:30 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:12:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Flow 'volume_create_manager' (da1fee8a-3321-4cfe-ba22-a316de7565b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4c3230-b3e2-459b-ade5-0bb4be13a529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4c3230-b3e2-459b-ade5-0bb4be13a529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1568181030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b84d34-fb4d-4007-9801-2ef756df9082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40dccfe3a79e41449abae7248142c71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:31Z,use_quota=True,user_id='a0b29d1b593e4a65bbd2101958828fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7683c187-0048-4c91-b777-e9fda235cdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7683c187-0048-4c91-b777-e9fda235cdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b233f3c8-9c0a-4705-8ed2-f3e65238898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b233f3c8-9c0a-4705-8ed2-f3e65238898d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02b84d34-fb4d-4007-9801-2ef756df9082', 'volume_name': 'volume-02b84d34-fb4d-4007-9801-2ef756df9082', 'volume_size': 2}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000906f8-ba76-47f5-b1ce-c2db89c3a74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000906f8-ba76-47f5-b1ce-c2db89c3a74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da603a48-c655-477d-a493-efcba958817e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:31 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Volume 02b84d34-fb4d-4007-9801-2ef756df9082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02b84d34-fb4d-4007-9801-2ef756df9082', 'volume_size': 2} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1568181030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b84d34-fb4d-4007-9801-2ef756df9082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40dccfe3a79e41449abae7248142c71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:31Z,use_quota=True,user_id='a0b29d1b593e4a65bbd2101958828fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Creating volume 02b84d34-fb4d-4007-9801-2ef756df9082 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:31 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 2147483648 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:31 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 2147483648 Sep 01 01:12:31 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:31 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 2147483648" returned: 0 in 0.790s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:31 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 Sep 01 01:12:31 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:32 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082" returned: 0 in 0.392s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da603a48-c655-477d-a493-efcba958817e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b84d34-fb4d-4007-9801-2ef756df9082', 'volume_size': 2}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343b4bd1-f197-46c9-bc50-b5acd04f1628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (27d6a0b0-ca46-4733-a40e-1eedb8341cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b2ff7-5ad9-4e80-8538-62e2f5e44ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:32 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Volume volume-02b84d34-fb4d-4007-9801-2ef756df9082 (02b84d34-fb4d-4007-9801-2ef756df9082): created successfully Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343b4bd1-f197-46c9-bc50-b5acd04f1628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Flow 'volume_create_manager' (da1fee8a-3321-4cfe-ba22-a316de7565b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b2ff7-5ad9-4e80-8538-62e2f5e44ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-551258758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db19fc9-99e9-48e8-9bdf-8a0f3116412d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:32Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6689e08-41cd-4911-ba21-4bef67036e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6689e08-41cd-4911-ba21-4bef67036e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f417ed1d-feb1-474f-bd0a-f66fc57cc0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f417ed1d-feb1-474f-bd0a-f66fc57cc0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db19fc9-99e9-48e8-9bdf-8a0f3116412d', 'volume_name': 'volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915e28ca-8ede-453d-a66d-96a53fe7aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915e28ca-8ede-453d-a66d-96a53fe7aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd3486f-bff0-4db8-b19d-efb23f7f9afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:32 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Volume 9db19fc9-99e9-48e8-9bdf-8a0f3116412d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d', 'volume_size': 1} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-551258758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db19fc9-99e9-48e8-9bdf-8a0f3116412d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:32Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Creating volume 9db19fc9-99e9-48e8-9bdf-8a0f3116412d {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:32 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-4cc82a7d-0cde-4aae-9e95-debeb5407b34 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Created volume successfully. Sep 01 01:12:32 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d 1073741824 Sep 01 01:12:32 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:33 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d 1073741824" returned: 0 in 0.618s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:33 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d Sep 01 01:12:33 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:33 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d" returned: 0 in 0.505s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.252s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd3486f-bff0-4db8-b19d-efb23f7f9afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86536a69-3ae1-4052-ba08-c47f04d97136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Creating offline snapshot df0265da-0770-4c88-82ab-88ec1dec9684 of volume 02b84d34-fb4d-4007-9801-2ef756df9082 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:12:33 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Volume volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d (9db19fc9-99e9-48e8-9bdf-8a0f3116412d): created successfully Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86536a69-3ae1-4052-ba08-c47f04d97136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (27d6a0b0-ca46-4733-a40e-1eedb8341cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[363ed492-8345-456a-ad79-252e7cd3719f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:33 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7991b4f8-5714-4c75-b167-ac0fbc8eb94f tempest-VolumesActionsTest-1040308440 None] Created volume successfully. Sep 01 01:12:33 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 Sep 01 01:12:33 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:34 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082" returned: 0 in 0.441s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 2G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:34 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 2G Sep 01 01:12:34 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Acquiring lock "cinder-9db19fc9-99e9-48e8-9bdf-8a0f3116412d-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Lock "cinder-9db19fc9-99e9-48e8-9bdf-8a0f3116412d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Acquiring lock "cinder-quobyte-9db19fc9-99e9-48e8-9bdf-8a0f3116412d" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Lock "cinder-quobyte-9db19fc9-99e9-48e8-9bdf-8a0f3116412d" acquired by "delete_volume" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:34 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[08acc398-419a-44e5-950c-4b365537b7c3]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:34 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 2G" returned: 0 in 0.722s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b84d34-fb4d-4007-9801-2ef756df9082 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:35 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b84d34-fb4d-4007-9801-2ef756df9082 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 Sep 01 01:12:35 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:35 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d Sep 01 01:12:35 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:35 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d" returned: 0 in 0.611s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:35 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d Sep 01 01:12:35 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:35 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b84d34-fb4d-4007-9801-2ef756df9082 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684" returned: 0 in 0.653s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:35 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 is being set with open permissions: ugo+rw Sep 01 01:12:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:35 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 Sep 01 01:12:35 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:36 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9db19fc9-99e9-48e8-9bdf-8a0f3116412d" returned: 0 in 0.502s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Lock "cinder-quobyte-9db19fc9-99e9-48e8-9bdf-8a0f3116412d" released by "delete_volume" :: held 1.180s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:36 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684" returned: 0 in 0.437s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Created reservations ['1cec28ad-e4e9-48ef-a7f8-b32483cb82aa', 'f2099acf-88e6-4e76-9cc8-71e663e91c55', '9aa4aa36-a6ba-4712-a189-ee9036e00bd0', '09aae400-07d8-474d-a8ad-6e863626f047'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:36 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.info Sep 01 01:12:36 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:36 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:36 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:36 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.info" returned: 0 in 0.503s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:36 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.info is being set with open permissions: ugo+rw Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:36 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.info Sep 01 01:12:36 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:36 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.586s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:36 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:36 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Deleted volume successfully. Sep 01 01:12:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-75eb3711-692d-497c-838a-16cf61805e7a tempest-VolumesActionsTest-1956640073 None] Lock "cinder-9db19fc9-99e9-48e8-9bdf-8a0f3116412d-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:37 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.info" returned: 0 in 0.432s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.423s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:37 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-332b8992-2270-42af-97f7-bc5ddc5e73c3 tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Create snapshot completed successfully Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Acquiring lock "cinder-df0265da-0770-4c88-82ab-88ec1dec9684-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "cinder-df0265da-0770-4c88-82ab-88ec1dec9684-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Acquiring lock "cinder-quobyte-02b84d34-fb4d-4007-9801-2ef756df9082" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "cinder-quobyte-02b84d34-fb4d-4007-9801-2ef756df9082" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Acquiring lock "cinder-quobyte-df0265da-0770-4c88-82ab-88ec1dec9684" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "cinder-quobyte-df0265da-0770-4c88-82ab-88ec1dec9684" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Deleting offline snapshot df0265da-0770-4c88-82ab-88ec1dec9684 of volume 02b84d34-fb4d-4007-9801-2ef756df9082 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] snapshot_file for this snap is: volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (5e30a665-ef4d-45e6-a68b-8f57399c79e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39776147-298f-4ad8-ad6f-dd046ecaf3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0df8d0f-b363-42f0-ada4-052d8c7fa749]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39776147-298f-4ad8-ad6f-dd046ecaf3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1007527877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e86524-9fcd-42c6-986d-e6ed9b12d7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:38Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab241570-8628-4d3c-8781-2d67baa19c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab241570-8628-4d3c-8781-2d67baa19c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293bd698-2ce3-44b2-b1f5-55517a6d80ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293bd698-2ce3-44b2-b1f5-55517a6d80ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7e86524-9fcd-42c6-986d-e6ed9b12d7e3', 'volume_name': 'volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28259e9c-4551-4b39-882a-33f4c558c92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28259e9c-4551-4b39-882a-33f4c558c92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b68d2a8-ad2c-4edc-b8ea-03b0a968f8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:38 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Volume a7e86524-9fcd-42c6-986d-e6ed9b12d7e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3', 'volume_size': 1} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1007527877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e86524-9fcd-42c6-986d-e6ed9b12d7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:38Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Creating volume a7e86524-9fcd-42c6-986d-e6ed9b12d7e3 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:38 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:38 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3 1073741824 Sep 01 01:12:38 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:38 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 Sep 01 01:12:38 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:38 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684" returned: 0 in 0.646s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02b84d34-fb4d-4007-9801-2ef756df9082(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b38c5f-1af1-4b50-bb10-c3985375c911]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:39 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3 1073741824" returned: 0 in 0.743s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Flow 'volume_create_manager' (058a3fa2-0d5f-43a5-88d4-e0bb259e17cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7df7a9c-1718-4951-832d-ed53aafe2401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:39 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 Sep 01 01:12:39 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7df7a9c-1718-4951-832d-ed53aafe2401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1575244287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117f3fbb-679e-429f-a159-692aaeab00c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbf048642f948eebf551efc2370f999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:39Z,use_quota=True,user_id='47ee4c15413c4ea4a80869c87af22ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629c470d-0d17-4e32-8edd-55826d34172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629c470d-0d17-4e32-8edd-55826d34172c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5760e18b-c0fd-43dc-8fbd-937fc4dbbd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5760e18b-c0fd-43dc-8fbd-937fc4dbbd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117f3fbb-679e-429f-a159-692aaeab00c4', 'volume_name': 'volume-117f3fbb-679e-429f-a159-692aaeab00c4', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2a906d-0e16-4953-b14b-2bb0601f4460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2a906d-0e16-4953-b14b-2bb0601f4460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c419703e-b0c2-4786-b018-45611a731a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Volume 117f3fbb-679e-429f-a159-692aaeab00c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117f3fbb-679e-429f-a159-692aaeab00c4', 'volume_size': 1} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:39 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3 Sep 01 01:12:39 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:39 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082" returned: 0 in 0.538s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:39 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 Sep 01 01:12:39 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:39 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3" returned: 0 in 0.368s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1575244287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117f3fbb-679e-429f-a159-692aaeab00c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbf048642f948eebf551efc2370f999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:39Z,use_quota=True,user_id='47ee4c15413c4ea4a80869c87af22ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Creating volume 117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:39 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:39 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 1073741824 Sep 01 01:12:39 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b68d2a8-ad2c-4edc-b8ea-03b0a968f8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828ba09c-d64d-4be7-8ada-a8ac9dab1def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Volume volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3 (a7e86524-9fcd-42c6-986d-e6ed9b12d7e3): created successfully Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828ba09c-d64d-4be7-8ada-a8ac9dab1def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (5e30a665-ef4d-45e6-a68b-8f57399c79e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:39 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-cff0d641-512a-4343-b798-c9c0abe79c58 tempest-VolumesActionsTest-1040308440 None] Created volume successfully. Sep 01 01:12:40 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684" returned: 0 in 0.687s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:40 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684 Sep 01 01:12:40 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:40 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 1073741824" returned: 0 in 0.764s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Acquiring lock "cinder-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:40 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 Sep 01 01:12:40 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Acquiring lock "cinder-quobyte-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:40 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082.df0265da-0770-4c88-82ab-88ec1dec9684" returned: 0 in 0.404s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-quobyte-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3" acquired by "delete_volume" :: waited 0.048s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "cinder-quobyte-df0265da-0770-4c88-82ab-88ec1dec9684" released by "_delete_snapshot" :: held 2.520s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e138c94-df38-48b5-b4fc-b0e38d444055]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "cinder-quobyte-02b84d34-fb4d-4007-9801-2ef756df9082" released by "delete_snapshot" :: held 2.580s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Created reservations ['261c3f58-bb14-4edc-bc52-e3eeffd65a4f', '9d5eeabc-7f31-4064-b6a9-8696755cd33b', 'af9de381-a533-4ac9-951b-3952dcd89f81', '2e91370e-e12f-46f0-8ee1-fcfbce18c570'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:40 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3 Sep 01 01:12:40 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:40 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4" returned: 0 in 0.362s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c419703e-b0c2-4786-b018-45611a731a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117f3fbb-679e-429f-a159-692aaeab00c4', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4f1be6-3de7-4922-ba4c-f0fbd0ff1f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:40 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Volume volume-117f3fbb-679e-429f-a159-692aaeab00c4 (117f3fbb-679e-429f-a159-692aaeab00c4): created successfully Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4f1be6-3de7-4922-ba4c-f0fbd0ff1f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Flow 'volume_create_manager' (058a3fa2-0d5f-43a5-88d4-e0bb259e17cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:40 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Delete snapshot completed successfully. Sep 01 01:12:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5e549d22-23f1-4bed-a722-b9bf629b18db tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "cinder-df0265da-0770-4c88-82ab-88ec1dec9684-delete_snapshot" released by "delete_snapshot" :: held 2.866s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:40 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f93021a6-1c34-42ab-a7c5-489f6e6134d1 tempest-SnapshotsActionsTest-708809949 None] Created volume successfully. Sep 01 01:12:41 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3" returned: 0 in 0.412s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:41 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3 Sep 01 01:12:41 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Acquiring lock "cinder-02b84d34-fb4d-4007-9801-2ef756df9082-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "cinder-02b84d34-fb4d-4007-9801-2ef756df9082-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:41 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3" returned: 0 in 0.426s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Acquiring lock "cinder-quobyte-02b84d34-fb4d-4007-9801-2ef756df9082" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-quobyte-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3" released by "delete_volume" :: held 0.920s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "cinder-quobyte-02b84d34-fb4d-4007-9801-2ef756df9082" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68513b2-0561-49de-b91f-58f171f06740]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] Creating offline snapshot cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 of volume 117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[330ae911-0174-47cf-be63-4ae7cb9f1d97]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:41 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Created reservations ['465907be-6dfd-4f74-b224-137f7945c6a6', 'e69e6f5b-4bfd-4b33-8639-b877075ccf23', '0f456fac-6e35-46b1-b699-df81554c9ce7', 'f136fd3e-3a77-4f1e-9d49-2312b85a92fd'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:41 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 Sep 01 01:12:41 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:42 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 Sep 01 01:12:42 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:42 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:42 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:42 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4" returned: 0 in 0.582s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:42 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 1G Sep 01 01:12:42 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:42 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082" returned: 0 in 0.731s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:42 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082 Sep 01 01:12:42 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:42 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.490s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:42 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Deleted volume successfully. Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d27f1be-dbff-4aea-b387-86ffbfa39a81 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-a7e86524-9fcd-42c6-986d-e6ed9b12d7e3-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:42 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-02b84d34-fb4d-4007-9801-2ef756df9082" returned: 0 in 0.358s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "cinder-quobyte-02b84d34-fb4d-4007-9801-2ef756df9082" released by "delete_volume" :: held 1.200s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=109,cinder:UPDATE=124,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:12:42 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 1G" returned: 0 in 0.510s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:42 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Created reservations ['417612dc-1209-4b56-b85e-e3d3141f6f32', 'a465ff51-1c7d-47b8-b259-628d59dc2134', '0124f90b-1f65-45ad-a791-7300b4b780c4', 'ba50683e-1419-4808-9517-c64b6fd04880'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:42 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:12:42 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:43 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:43 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:43 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.447s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:43 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 is being set with open permissions: ugo+rw Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:43 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.326s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:43 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Deleted volume successfully. Sep 01 01:12:43 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:12:43 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cce3720c-e606-4ffc-bc7d-f46f342b1d2b tempest-VolumesSnapshotNegativeTestJSON-2032783001 None] Lock "cinder-02b84d34-fb4d-4007-9801-2ef756df9082-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:43 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.377s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:12:43 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.info Sep 01 01:12:43 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (4fd869d4-4742-4704-9966-4d0e90262f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102b05b2-4927-4dbd-bb41-4387fabfb4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102b05b2-4927-4dbd-bb41-4387fabfb4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1186609968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276f0ba8-b90f-49e1-9961-8e8a56bbad93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:44Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2eaa31d-c543-45a7-b57b-d1ae15f979ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2eaa31d-c543-45a7-b57b-d1ae15f979ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206c8464-e291-4e99-b4d8-67d0c2c82955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206c8464-e291-4e99-b4d8-67d0c2c82955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276f0ba8-b90f-49e1-9961-8e8a56bbad93', 'volume_name': 'volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa833f7-00e3-4f17-a8f8-e899cc1d5b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa833f7-00e3-4f17-a8f8-e899cc1d5b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be67b52-b1c3-48c0-a8a2-7543ddc4e8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:43 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Volume 276f0ba8-b90f-49e1-9961-8e8a56bbad93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93', 'volume_size': 1} Sep 01 01:12:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:44 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.info" returned: 0 in 0.366s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:44 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.info is being set with open permissions: ugo+rw Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:44 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.info Sep 01 01:12:44 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:44 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.info" returned: 0 in 0.368s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.860s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1186609968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276f0ba8-b90f-49e1-9961-8e8a56bbad93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:44Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Creating volume 276f0ba8-b90f-49e1-9961-8e8a56bbad93 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:44 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:44 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93 1073741824 Sep 01 01:12:44 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:44 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b1f37e65-e830-4a01-ab5b-d92ab176b357 tempest-SnapshotsActionsTest-708809949 None] Create snapshot completed successfully Sep 01 01:12:45 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93 1073741824" returned: 0 in 0.812s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:45 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93 Sep 01 01:12:45 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:46 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93" returned: 0 in 0.565s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be67b52-b1c3-48c0-a8a2-7543ddc4e8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bc7cb3-e14f-4f25-b02b-b9baac1ae227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:46 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Volume volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93 (276f0ba8-b90f-49e1-9961-8e8a56bbad93): created successfully Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bc7cb3-e14f-4f25-b02b-b9baac1ae227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (4fd869d4-4742-4704-9966-4d0e90262f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] Creating offline snapshot e218b6ca-bd42-4bea-87a2-af550a518167 of volume 117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:12:46 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-43b00b23-200e-4459-800c-e506cc14606a tempest-VolumesActionsTest-1040308440 None] Created volume successfully. Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46e9d2d-ae47-401a-a858-65668ab23976]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:46 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:12:46 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:46 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.654s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:12:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:47 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 1G Sep 01 01:12:47 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Acquiring lock "cinder-276f0ba8-b90f-49e1-9961-8e8a56bbad93-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-276f0ba8-b90f-49e1-9961-8e8a56bbad93-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Acquiring lock "cinder-quobyte-276f0ba8-b90f-49e1-9961-8e8a56bbad93" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-quobyte-276f0ba8-b90f-49e1-9961-8e8a56bbad93" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:47 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[39381bba-7f7f-4fa3-9a4f-6b300886208d]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:47 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93 Sep 01 01:12:47 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:47 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 1G" returned: 0 in 0.928s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:47 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 Sep 01 01:12:47 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:48 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93" returned: 0 in 0.656s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:48 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93 Sep 01 01:12:48 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:48 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167" returned: 0 in 0.496s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:48 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 is being set with open permissions: ugo+rw Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:48 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 Sep 01 01:12:48 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:48 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-276f0ba8-b90f-49e1-9961-8e8a56bbad93" returned: 0 in 0.349s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-quobyte-276f0ba8-b90f-49e1-9961-8e8a56bbad93" released by "delete_volume" :: held 1.088s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=134,cinder:DELETE=11,cinder:INSERT=33,cinder:SELECT=98 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:12:48 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167" returned: 0 in 0.332s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Created reservations ['067bdd6e-5c5f-4105-9aef-cab8ebc55f1d', '911c1afc-5986-44f6-a2d1-6bd16c75cf9c', 'a5c4fd5a-d85a-42ec-8c54-7e332fb0a3d9', '58dd636d-41e8-4faa-be65-c9bc9bfa64fa'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.580s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:48 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-fb722626-f5b3-40bb-943c-9f72362a0f33 tempest-SnapshotsActionsTest-708809949 None] Create snapshot completed successfully Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:48 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:48 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:49 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.344s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:49 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Deleted volume successfully. Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4f9d11c-0280-444f-b0c6-749aa96bd822 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-276f0ba8-b90f-49e1-9961-8e8a56bbad93-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-e218b6ca-bd42-4bea-87a2-af550a518167-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-e218b6ca-bd42-4bea-87a2-af550a518167-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-quobyte-e218b6ca-bd42-4bea-87a2-af550a518167" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-e218b6ca-bd42-4bea-87a2-af550a518167" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Deleting offline snapshot e218b6ca-bd42-4bea-87a2-af550a518167 of volume 117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] snapshot_file for this snap is: volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5fcc89-e18c-4908-886d-eb743048311a]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:49 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 Sep 01 01:12:49 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:50 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167" returned: 0 in 0.571s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[20964d77-079c-4934-af2b-d80515f64696]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:50 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:12:50 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (1d4f88e6-432a-4bf5-8742-e5813d5576b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3867d820-a574-4894-9194-6700340aca81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3867d820-a574-4894-9194-6700340aca81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415547612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3127d235-045e-417d-b135-c1fe5dcb3e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:51Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9d7972-7375-4bcb-bd66-fd84fb6eaa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9d7972-7375-4bcb-bd66-fd84fb6eaa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f282e2f0-a0b8-4254-9d1f-30dcd3808d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f282e2f0-a0b8-4254-9d1f-30dcd3808d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3127d235-045e-417d-b135-c1fe5dcb3e65', 'volume_name': 'volume-3127d235-045e-417d-b135-c1fe5dcb3e65', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea9c651-99c9-41bf-9cae-5c01ca784a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea9c651-99c9-41bf-9cae-5c01ca784a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cee4860-027a-421f-a3a9-0b048f3f3176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:50 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Volume 3127d235-045e-417d-b135-c1fe5dcb3e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3127d235-045e-417d-b135-c1fe5dcb3e65', 'volume_size': 1} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415547612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3127d235-045e-417d-b135-c1fe5dcb3e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:51Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Creating volume 3127d235-045e-417d-b135-c1fe5dcb3e65 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:50 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:50 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65 1073741824 Sep 01 01:12:50 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:51 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.708s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:51 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 Sep 01 01:12:51 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:51 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65 1073741824" returned: 0 in 0.671s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Flow 'volume_create_manager' (4e675df1-1f73-44b7-82e2-e3058c5ba537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c784c1-2b53-4a04-8a6e-4e5e0dfbae34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:51 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167" returned: 0 in 0.613s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:51 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65 Sep 01 01:12:51 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c784c1-2b53-4a04-8a6e-4e5e0dfbae34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2122004781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b623891a-8767-421d-8eef-23cd3d8c23a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cb634f41f74358a74116f556ee46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:52Z,use_quota=True,user_id='1a5403d405024a6a8c117b4eb2e5023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56770513-650e-4715-93a5-3e12a58d1bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:51 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167 Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56770513-650e-4715-93a5-3e12a58d1bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:51 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8107629-47b5-42bb-bb13-1c251320deeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8107629-47b5-42bb-bb13-1c251320deeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b623891a-8767-421d-8eef-23cd3d8c23a9', 'volume_name': 'volume-b623891a-8767-421d-8eef-23cd3d8c23a9', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb882cd-4216-4291-9778-9e30d802acbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb882cd-4216-4291-9778-9e30d802acbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bce80d6-2723-4722-8241-0d327c5eea34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:51 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Volume b623891a-8767-421d-8eef-23cd3d8c23a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b623891a-8767-421d-8eef-23cd3d8c23a9', 'volume_size': 1} Sep 01 01:12:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:52 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65" returned: 0 in 0.360s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.259s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2122004781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b623891a-8767-421d-8eef-23cd3d8c23a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cb634f41f74358a74116f556ee46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:52Z,use_quota=True,user_id='1a5403d405024a6a8c117b4eb2e5023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Creating volume b623891a-8767-421d-8eef-23cd3d8c23a9 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:52 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:52 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cee4860-027a-421f-a3a9-0b048f3f3176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3127d235-045e-417d-b135-c1fe5dcb3e65', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:52 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 1073741824 Sep 01 01:12:52 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0d96cd-45a9-4152-a47d-9a77911e3bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.e218b6ca-bd42-4bea-87a2-af550a518167" returned: 0 in 0.411s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Volume volume-3127d235-045e-417d-b135-c1fe5dcb3e65 (3127d235-045e-417d-b135-c1fe5dcb3e65): created successfully Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0d96cd-45a9-4152-a47d-9a77911e3bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (1d4f88e6-432a-4bf5-8742-e5813d5576b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-e218b6ca-bd42-4bea-87a2-af550a518167" released by "_delete_snapshot" :: held 2.538s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" released by "delete_snapshot" :: held 2.598s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:52 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-aa778bc9-7d33-4123-ad9d-f64802e2b346 tempest-VolumesActionsTest-1040308440 None] Created volume successfully. Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Created reservations ['a6cac144-d2b9-421d-92e1-8dc53d45d6c6', 'b80a20f3-b865-4016-94ab-6f5e8390c7b5', '8db30bf0-b146-492b-a0ec-6dc2ca96fa9d', 'c8864a14-21d7-473a-88dd-ae96d4686323'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:52 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Delete snapshot completed successfully. Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7830d35e-1cc7-435b-b767-7f68c210eef5 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-e218b6ca-bd42-4bea-87a2-af550a518167-delete_snapshot" released by "delete_snapshot" :: held 2.850s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:52 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:52 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:52 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 1073741824" returned: 0 in 0.657s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:52 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 Sep 01 01:12:52 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Acquiring lock "cinder-3127d235-045e-417d-b135-c1fe5dcb3e65-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-3127d235-045e-417d-b135-c1fe5dcb3e65-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:53 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.548s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Acquiring lock "cinder-quobyte-3127d235-045e-417d-b135-c1fe5dcb3e65" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-quobyte-3127d235-045e-417d-b135-c1fe5dcb3e65" acquired by "delete_volume" :: waited 0.034s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:53 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9" returned: 0 in 0.541s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[73008a3d-8ee4-4e5f-a521-3228a7658c5c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bce80d6-2723-4722-8241-0d327c5eea34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b623891a-8767-421d-8eef-23cd3d8c23a9', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841d6cfe-b946-452d-94c2-bc5de8973c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] Creating offline snapshot 715e7ab7-ba0c-4984-ac9b-b92113f983de of volume 117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8588771-21bc-4549-81ba-0d5536e3e886]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:53 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Volume volume-b623891a-8767-421d-8eef-23cd3d8c23a9 (b623891a-8767-421d-8eef-23cd3d8c23a9): created successfully Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841d6cfe-b946-452d-94c2-bc5de8973c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:53 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65 Sep 01 01:12:53 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Flow 'volume_create_manager' (4e675df1-1f73-44b7-82e2-e3058c5ba537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:53 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ae80e638-3d84-4de2-99ff-5d5a436c87eb tempest-VolumesSnapshotTestJSON-713433623 None] Created volume successfully. Sep 01 01:12:53 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:12:53 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:53 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65" returned: 0 in 0.577s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:53 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65 Sep 01 01:12:54 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:54 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.654s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:54 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de 1G Sep 01 01:12:54 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:54 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3127d235-045e-417d-b135-c1fe5dcb3e65" returned: 0 in 0.416s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-quobyte-3127d235-045e-417d-b135-c1fe5dcb3e65" released by "delete_volume" :: held 1.072s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Created reservations ['9625b575-1e10-4ba8-ac31-46a18e3d88f7', '7dd19ba4-5942-484c-8922-a81fdb18a10d', 'a8772484-1cd6-4776-966a-e52032eef66c', '9818e580-a832-4bb6-9995-0dbbef440d8d'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:54 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:12:54 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:54 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de 1G" returned: 0 in 0.648s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:54 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de Sep 01 01:12:54 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:54 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.329s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:12:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Deleted volume successfully. Sep 01 01:12:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8b74331-1abb-45c3-95b0-7793baaaaf20 tempest-VolumesActionsTest-1956640073 None] Lock "cinder-3127d235-045e-417d-b135-c1fe5dcb3e65-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:55 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de" returned: 0 in 0.385s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:55 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de is being set with open permissions: ugo+rw Sep 01 01:12:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:55 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de Sep 01 01:12:55 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:55 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de" returned: 0 in 0.373s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.257s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.429s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] Creating offline snapshot 1a06b4a3-d029-422f-9cb9-cb7201be8613 of volume b623891a-8767-421d-8eef-23cd3d8c23a9 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:12:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cef840-4aff-4bca-8967-ee22f34d9ca0]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e93d9f82-4e7c-476d-85eb-fa07b502ae5b tempest-SnapshotsActionsTest-708809949 None] Create snapshot completed successfully Sep 01 01:12:55 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 Sep 01 01:12:55 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:56 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (b0f7aa3c-28f0-494b-9eb8-2e6c4d4f8737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55db659b-d8b2-4ec2-9811-30dd033dca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9" returned: 0 in 0.511s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55db659b-d8b2-4ec2-9811-30dd033dca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1797261062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7141649-d25c-485d-8b9a-cf63246c12eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:56Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:56 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 1G Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce05b96-0fd8-4b04-8ad2-e1b2ac66f7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:56 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce05b96-0fd8-4b04-8ad2-e1b2ac66f7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab58e96-476b-4955-99d0-933f193d6982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab58e96-476b-4955-99d0-933f193d6982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7141649-d25c-485d-8b9a-cf63246c12eb', 'volume_name': 'volume-b7141649-d25c-485d-8b9a-cf63246c12eb', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5066c4d-189f-4c21-91cf-66aaa8ef2394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5066c4d-189f-4c21-91cf-66aaa8ef2394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b27f22-9a8c-452c-a117-3b3ed3ff9fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:56 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Volume b7141649-d25c-485d-8b9a-cf63246c12eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7141649-d25c-485d-8b9a-cf63246c12eb', 'volume_size': 1} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-715e7ab7-ba0c-4984-ac9b-b92113f983de-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-715e7ab7-ba0c-4984-ac9b-b92113f983de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-quobyte-715e7ab7-ba0c-4984-ac9b-b92113f983de" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-715e7ab7-ba0c-4984-ac9b-b92113f983de" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Deleting offline snapshot 715e7ab7-ba0c-4984-ac9b-b92113f983de of volume 117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] snapshot_file for this snap is: volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9d67ae-4460-4520-8ecb-213e6b4e29ec]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:56 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 1G" returned: 0 in 0.585s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b623891a-8767-421d-8eef-23cd3d8c23a9 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:56 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b623891a-8767-421d-8eef-23cd3d8c23a9 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 Sep 01 01:12:56 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:56 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de Sep 01 01:12:56 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:57 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b623891a-8767-421d-8eef-23cd3d8c23a9 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613" returned: 0 in 0.502s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:57 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 is being set with open permissions: ugo+rw Sep 01 01:12:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:57 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 Sep 01 01:12:57 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:57 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de" returned: 0 in 0.599s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:12:57 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bced9e4d-3a2a-4974-9f23-91e178769ea7]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:57 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:12:57 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:57 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613" returned: 0 in 0.315s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:57 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.info Sep 01 01:12:57 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:57 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.437s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:12:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:57 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de Sep 01 01:12:57 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:58 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.info" returned: 0 in 0.328s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:58 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.info is being set with open permissions: ugo+rw Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:58 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.info Sep 01 01:12:58 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:58 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.info" returned: 0 in 0.338s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.779s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.100s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1797261062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7141649-d25c-485d-8b9a-cf63246c12eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2d6a1e4b414000814395dfe4037237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:12:56Z,use_quota=True,user_id='807952b46dc940418074f3727f66613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Creating volume b7141649-d25c-485d-8b9a-cf63246c12eb {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:12:58 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:12:58 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de" returned: 0 in 0.556s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:58 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb 1073741824 Sep 01 01:12:58 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:58 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de Sep 01 01:12:58 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:58 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8a17f43b-02e8-4aa0-8695-a9877d10ddba tempest-VolumesSnapshotTestJSON-713433623 None] Create snapshot completed successfully Sep 01 01:12:58 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.715e7ab7-ba0c-4984-ac9b-b92113f983de" returned: 0 in 0.376s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-715e7ab7-ba0c-4984-ac9b-b92113f983de" released by "_delete_snapshot" :: held 2.092s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" released by "delete_snapshot" :: held 2.126s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:58 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Created reservations ['50f281fa-9960-4302-9378-271598f01f41', '1ae91d0b-41d3-4202-a362-671ebd244237', '085357a6-5f7d-4239-9049-4a2e06629e65', '364229a5-9b0b-49a4-8c8f-e7fd3106c3e9'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:12:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Delete snapshot completed successfully. Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-357eb81b-13af-486f-8b43-8ae6666b746a tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-715e7ab7-ba0c-4984-ac9b-b92113f983de-delete_snapshot" released by "delete_snapshot" :: held 2.336s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:12:59 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb 1073741824" returned: 0 in 0.701s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:59 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb Sep 01 01:12:59 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:12:59 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb" returned: 0 in 0.327s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b27f22-9a8c-452c-a117-3b3ed3ff9fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7141649-d25c-485d-8b9a-cf63246c12eb', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35826410-f5f9-4a8e-950c-ab2de1903a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:12:59 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Volume volume-b7141649-d25c-485d-8b9a-cf63246c12eb (b7141649-d25c-485d-8b9a-cf63246c12eb): created successfully Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35826410-f5f9-4a8e-950c-ab2de1903a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Flow 'volume_create_manager' (b0f7aa3c-28f0-494b-9eb8-2e6c4d4f8737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:12:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6f317430-5b5b-4241-b44c-c4619c579b7b tempest-VolumesActionsTest-1040308440 None] Created volume successfully. Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-1a06b4a3-d029-422f-9cb9-cb7201be8613-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-1a06b4a3-d029-422f-9cb9-cb7201be8613-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-b623891a-8767-421d-8eef-23cd3d8c23a9" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-b623891a-8767-421d-8eef-23cd3d8c23a9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-1a06b4a3-d029-422f-9cb9-cb7201be8613" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-1a06b4a3-d029-422f-9cb9-cb7201be8613" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Deleting offline snapshot 1a06b4a3-d029-422f-9cb9-cb7201be8613 of volume b623891a-8767-421d-8eef-23cd3d8c23a9 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] snapshot_file for this snap is: volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[519f196d-4c4f-4469-853b-b83c728d2144]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:12:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:12:59 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 Sep 01 01:12:59 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:00 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613" returned: 0 in 0.599s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b623891a-8767-421d-8eef-23cd3d8c23a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d3646c-9ab3-4c61-911e-ba90e076916f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] Creating offline snapshot 2e934da7-2cd0-4352-b3db-e0aff69d533a of volume 117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:13:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f605e0e5-cbff-47c8-82eb-dcee08bd3683]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:00 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 Sep 01 01:13:00 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:00 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:13:00 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:01 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9" returned: 0 in 0.540s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:01 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 Sep 01 01:13:01 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:01 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.571s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:01 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a 1G Sep 01 01:13:01 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Acquiring lock "cinder-b7141649-d25c-485d-8b9a-cf63246c12eb-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Lock "cinder-b7141649-d25c-485d-8b9a-cf63246c12eb-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Acquiring lock "cinder-quobyte-b7141649-d25c-485d-8b9a-cf63246c12eb" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Lock "cinder-quobyte-b7141649-d25c-485d-8b9a-cf63246c12eb" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e581eb12-19b4-4aca-8163-02ceba844fc2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:01 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613" returned: 0 in 0.616s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:01 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613 Sep 01 01:13:01 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:01 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb Sep 01 01:13:01 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:01 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a 1G" returned: 0 in 0.657s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:01 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a Sep 01 01:13:01 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:02 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9.1a06b4a3-d029-422f-9cb9-cb7201be8613" returned: 0 in 0.358s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-1a06b4a3-d029-422f-9cb9-cb7201be8613" released by "_delete_snapshot" :: held 2.289s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:02 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-b623891a-8767-421d-8eef-23cd3d8c23a9" released by "delete_snapshot" :: held 2.320s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb" returned: 0 in 0.488s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:02 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb Sep 01 01:13:02 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Created reservations ['69ebab0e-74b8-42d1-af37-54bd7852ab46', 'b3b17b3f-1978-415a-87c1-133580087d58', '8124d9ed-6fd9-4ae9-bc2c-06e2859b3dce', '4666d542-c67e-4b70-be1c-81cc5852758d'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:02 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a" returned: 0 in 0.388s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:02 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a is being set with open permissions: ugo+rw Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:02 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a Sep 01 01:13:02 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Delete snapshot completed successfully. Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8dbf29da-8a01-46d4-9459-104e49f6ed3a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-1a06b4a3-d029-422f-9cb9-cb7201be8613-delete_snapshot" released by "delete_snapshot" :: held 2.623s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:02 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b7141649-d25c-485d-8b9a-cf63246c12eb" returned: 0 in 0.422s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Lock "cinder-quobyte-b7141649-d25c-485d-8b9a-cf63246c12eb" released by "delete_volume" :: held 0.967s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:02 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a" returned: 0 in 0.342s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Created reservations ['f2a30008-c23a-4597-b0ed-111f57b1f7e8', '973575b9-2af6-4b28-9ab4-168391ca39b8', 'b2e26aeb-2e9d-45e1-85ff-7fee6f123910', '120d8465-80fd-4015-ac41-7ba2f6325d3c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-926736ab-a927-4dc8-a58e-32f5314d283a tempest-SnapshotsActionsTest-708809949 None] Create snapshot completed successfully Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:02 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:02 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:03 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.439s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:03 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:03 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Deleted volume successfully. Sep 01 01:13:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2a9c01a4-dcee-45bb-baea-f18eff5638cd tempest-VolumesActionsTest-1040308440 None] Lock "cinder-b7141649-d25c-485d-8b9a-cf63246c12eb-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-2e934da7-2cd0-4352-b3db-e0aff69d533a-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Flow 'volume_create_manager' (abd71334-6e27-427d-978b-bf063ad0b159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e62430-11b3-4d1d-8092-2c8a02b2d5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-2e934da7-2cd0-4352-b3db-e0aff69d533a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.109s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e62430-11b3-4d1d-8092-2c8a02b2d5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1222322855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbe7ba4-0953-4b76-b944-2055df245cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cb634f41f74358a74116f556ee46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:04Z,use_quota=True,user_id='1a5403d405024a6a8c117b4eb2e5023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8e3701-db5f-4976-a499-e0dedbad916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8e3701-db5f-4976-a499-e0dedbad916e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce56713-f74c-423e-b23f-ec8a7def8f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce56713-f74c-423e-b23f-ec8a7def8f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfbe7ba4-0953-4b76-b944-2055df245cb2', 'volume_name': 'volume-cfbe7ba4-0953-4b76-b944-2055df245cb2', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb01505-23a6-4890-b958-4122718537e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb01505-23a6-4890-b958-4122718537e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c77b683-fa02-4f6b-ac49-e2e4c83ab063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:04 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Volume cfbe7ba4-0953-4b76-b944-2055df245cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfbe7ba4-0953-4b76-b944-2055df245cb2', 'volume_size': 1} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1222322855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbe7ba4-0953-4b76-b944-2055df245cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cb634f41f74358a74116f556ee46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:04Z,use_quota=True,user_id='1a5403d405024a6a8c117b4eb2e5023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Creating volume cfbe7ba4-0953-4b76-b944-2055df245cb2 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:13:04 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" acquired by "delete_snapshot" :: waited 0.132s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-quobyte-2e934da7-2cd0-4352-b3db-e0aff69d533a" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:04 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 1073741824 Sep 01 01:13:04 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-2e934da7-2cd0-4352-b3db-e0aff69d533a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Deleting offline snapshot 2e934da7-2cd0-4352-b3db-e0aff69d533a of volume 117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] snapshot_file for this snap is: volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1498d81f-929e-465c-9151-76765ba10e7a]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:04 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a Sep 01 01:13:04 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:04 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a" returned: 0 in 0.488s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38f227f-f40d-45ab-83b1-5d4aa09fcfa0]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:04 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 1073741824" returned: 0 in 0.685s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:04 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 Sep 01 01:13:04 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:04 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:13:04 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:05 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2" returned: 0 in 0.379s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:13:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c77b683-fa02-4f6b-ac49-e2e4c83ab063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfbe7ba4-0953-4b76-b944-2055df245cb2', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89cfaa99-f815-46d3-ba40-95c41fa77e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:05 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Volume volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 (cfbe7ba4-0953-4b76-b944-2055df245cb2): created successfully Sep 01 01:13:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89cfaa99-f815-46d3-ba40-95c41fa77e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Flow 'volume_create_manager' (abd71334-6e27-427d-978b-bf063ad0b159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:05 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d0463a8c-4cbb-45e4-aebe-57ff5d743ed9 tempest-VolumesSnapshotTestJSON-713433623 None] Created volume successfully. Sep 01 01:13:05 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.632s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:05 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a Sep 01 01:13:05 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:06 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a" returned: 0 in 0.592s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:06 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a Sep 01 01:13:06 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:06 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.2e934da7-2cd0-4352-b3db-e0aff69d533a" returned: 0 in 0.428s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] Creating offline snapshot e32ad37f-0e3a-4803-8da6-092d9d6d958e of volume cfbe7ba4-0953-4b76-b944-2055df245cb2 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-2e934da7-2cd0-4352-b3db-e0aff69d533a" released by "_delete_snapshot" :: held 2.296s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" released by "delete_snapshot" :: held 2.329s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8679e415-57bd-45c2-80e5-d471bfe87b63]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Created reservations ['13c543a8-ab44-4dc6-8805-c7c2b121432f', 'f151b55b-fc76-484f-8641-43043810d740', '7e711146-5e3b-465f-9f23-75d4163a2686', '5d92f22e-616c-4c12-9d90-40035d21a271'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:06 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 Sep 01 01:13:06 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Delete snapshot completed successfully. Sep 01 01:13:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-851089b1-fd9b-4d99-89d6-438666828259 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-2e934da7-2cd0-4352-b3db-e0aff69d533a-delete_snapshot" released by "delete_snapshot" :: held 2.664s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:07 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2" returned: 0 in 0.475s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:07 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e 1G Sep 01 01:13:07 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:07 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e 1G" returned: 0 in 0.639s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:07 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e Sep 01 01:13:07 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:08 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e" returned: 0 in 0.449s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:08 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e is being set with open permissions: ugo+rw Sep 01 01:13:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:08 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e Sep 01 01:13:08 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:08 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e" returned: 0 in 0.331s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:08 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.info Sep 01 01:13:08 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:08 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.info" returned: 0 in 0.304s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:08 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.info is being set with open permissions: ugo+rw Sep 01 01:13:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:08 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.info Sep 01 01:13:08 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:09 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.info" returned: 0 in 0.256s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.638s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.348s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] Creating offline snapshot b2f1972d-e583-4d03-9105-c5fcebecf288 of volume 117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:13:09 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-001bbf86-74f3-4eb2-919f-86afc28cb29d tempest-VolumesSnapshotTestJSON-713433623 None] Create snapshot completed successfully Sep 01 01:13:09 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d5f872-ece3-414b-a35a-4e7246597b4e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:09 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:13:09 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:09 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.569s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:09 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 1G Sep 01 01:13:09 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:10 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 1G" returned: 0 in 0.729s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:10 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 Sep 01 01:13:10 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Flow 'volume_create_manager' (12c97a78-ec68-427e-837f-f389659ee4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d0a82a-53f6-4bdf-b952-e54415cd5710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d0a82a-53f6-4bdf-b952-e54415cd5710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-123219248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1b63b2-8dda-4dbd-9bbc-59d353424263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cb634f41f74358a74116f556ee46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e32ad37f-0e3a-4803-8da6-092d9d6d958e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:10Z,use_quota=True,user_id='1a5403d405024a6a8c117b4eb2e5023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973b6fae-a01c-4dc0-b985-eab720aecf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973b6fae-a01c-4dc0-b985-eab720aecf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df95028b-0e99-4778-bd65-70c4ea6f0edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df95028b-0e99-4778-bd65-70c4ea6f0edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd1b63b2-8dda-4dbd-9bbc-59d353424263', 'volume_name': 'volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263', 'volume_size': 2, 'snapshot_id': 'e32ad37f-0e3a-4803-8da6-092d9d6d958e'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa4e5ba-b126-47ca-bf96-d94aeeccb22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa4e5ba-b126-47ca-bf96-d94aeeccb22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899d21c4-a14a-4b45-a5dd-194a0460b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:10 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Volume cd1b63b2-8dda-4dbd-9bbc-59d353424263: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263', 'volume_size': 2, 'snapshot_id': 'e32ad37f-0e3a-4803-8da6-092d9d6d958e'} Sep 01 01:13:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:11 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288" returned: 0 in 0.544s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:11 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 is being set with open permissions: ugo+rw Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:11 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 Sep 01 01:13:11 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:11 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288" returned: 0 in 0.466s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.483s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.813s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-e32ad37f-0e3a-4803-8da6-092d9d6d958e-cd1b63b2-8dda-4dbd-9bbc-59d353424263" by "_create_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-e32ad37f-0e3a-4803-8da6-092d9d6d958e-cd1b63b2-8dda-4dbd-9bbc-59d353424263" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Creating volume cd1b63b2-8dda-4dbd-9bbc-59d353424263 from snapshot e32ad37f-0e3a-4803-8da6-092d9d6d958e {{(pid=87064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-cd1b63b2-8dda-4dbd-9bbc-59d353424263" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:11 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c739a5ba-37ce-41f9-be24-373d38d42bb7 tempest-SnapshotsActionsTest-708809949 None] Create snapshot completed successfully Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-cd1b63b2-8dda-4dbd-9bbc-59d353424263" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] snapshot: e32ad37f-0e3a-4803-8da6-092d9d6d958e, volume: cd1b63b2-8dda-4dbd-9bbc-59d353424263, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4020babc-1157-4d06-9bba-bbb2f3a5b5e7]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:11 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e Sep 01 01:13:11 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-b2f1972d-e583-4d03-9105-c5fcebecf288-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-b2f1972d-e583-4d03-9105-c5fcebecf288-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Acquiring lock "cinder-quobyte-b2f1972d-e583-4d03-9105-c5fcebecf288" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-b2f1972d-e583-4d03-9105-c5fcebecf288" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Deleting offline snapshot b2f1972d-e583-4d03-9105-c5fcebecf288 of volume 117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] snapshot_file for this snap is: volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:13:12 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e" returned: 0 in 0.520s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfbe7ba4-0953-4b76-b944-2055df245cb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1366019-0f49-4f5c-a51e-7ada0adb8350]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d023049-0f4b-4a68-a217-ff98db6f9ef1]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:12 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 Sep 01 01:13:12 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:12 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 Sep 01 01:13:12 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:12 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288" returned: 0 in 0.519s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:12 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2" returned: 0 in 0.546s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3db821-41a2-42fc-89c9-a62068ade548]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:12 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 Sep 01 01:13:12 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:13 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:13:13 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:13 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.585s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:13 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 Sep 01 01:13:13 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:14 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288" returned: 0 in 0.850s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:14 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288 Sep 01 01:13:14 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:15 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.b2f1972d-e583-4d03-9105-c5fcebecf288" returned: 0 in 1.141s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-b2f1972d-e583-4d03-9105-c5fcebecf288" released by "_delete_snapshot" :: held 3.266s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" released by "delete_snapshot" :: held 3.323s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:15 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Created reservations ['b9cb8674-9637-4eab-a9da-534812624059', 'c1ba43d4-0257-491f-94f2-06d554b6e663', '155d39d5-1629-4aeb-b776-d807fc1b8654', '6a64ea01-cee4-4b8a-829d-ca809599f8f5'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Delete snapshot completed successfully. Sep 01 01:13:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a337dfd3-7b85-460b-a2dd-441e6855fcd4 tempest-SnapshotsActionsTest-1925775813 None] Lock "cinder-b2f1972d-e583-4d03-9105-c5fcebecf288-delete_snapshot" released by "delete_snapshot" :: held 3.624s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "cinder-cbd32746-5f72-44e0-abf4-c7d5e35dc7a7-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Lock "cinder-cbd32746-5f72-44e0-abf4-c7d5e35dc7a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "cinder-quobyte-cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Lock "cinder-quobyte-cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Deleting offline snapshot cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 of volume 117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:13:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] snapshot_file for this snap is: volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:13:17 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57806aa-ddc6-4d11-946c-ec32f20fa29c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:18 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:13:18 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:19 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 1.289s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f3fbb-679e-429f-a159-692aaeab00c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:19 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d58a0a9-4ed9-465d-87ae-2f7ea32856d6]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:19 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263" returned: 0 in 6.664s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:19 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:13:19 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Converted 1024.00 MB image at 153.64 MB/s Sep 01 01:13:19 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 is being set with open permissions: ugo+rw Sep 01 01:13:19 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 Sep 01 01:13:19 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:19 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 Sep 01 01:13:19 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:19 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4" returned: 0 in 0.599s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:19 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:13:19 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:19 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263" returned: 0 in 0.388s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-cd1b63b2-8dda-4dbd-9bbc-59d353424263" released by "_copy_volume_from_snapshot" :: held 8.263s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-e32ad37f-0e3a-4803-8da6-092d9d6d958e-cd1b63b2-8dda-4dbd-9bbc-59d353424263" released by "_create_volume_from_snapshot" :: held 8.389s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.442s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899d21c4-a14a-4b45-a5dd-194a0460b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263', 'volume_size': 2, 'snapshot_id': 'e32ad37f-0e3a-4803-8da6-092d9d6d958e'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef29c9cf-16dc-4847-a12c-34ee8fd82494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:20 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Volume volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 (cd1b63b2-8dda-4dbd-9bbc-59d353424263): created successfully Sep 01 01:13:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef29c9cf-16dc-4847-a12c-34ee8fd82494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Flow 'volume_create_manager' (12c97a78-ec68-427e-837f-f389659ee4ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:20 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-faa3ed45-7028-4baf-b774-1d01b740fb85 tempest-VolumesSnapshotTestJSON-713433623 None] Created volume successfully. Sep 01 01:13:20 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.649s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:20 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7 Sep 01 01:13:20 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-cd1b63b2-8dda-4dbd-9bbc-59d353424263-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-cd1b63b2-8dda-4dbd-9bbc-59d353424263-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:20 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4.cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" returned: 0 in 0.441s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-cd1b63b2-8dda-4dbd-9bbc-59d353424263" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Lock "cinder-quobyte-cbd32746-5f72-44e0-abf4-c7d5e35dc7a7" released by "_delete_snapshot" :: held 3.279s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" released by "delete_snapshot" :: held 3.341s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-cd1b63b2-8dda-4dbd-9bbc-59d353424263" acquired by "delete_volume" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13c1e1a-2eec-4d3f-a16c-158569f735ca]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Created reservations ['c89640c0-fb90-4ae9-afc5-17f69d7fec61', '92163f1a-20de-4126-be1d-aa5c89623096', '5529ded1-e4d2-40cb-b855-153e0d92719e', 'd16444d3-ff65-46e2-9827-f23739f84cb9'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:21 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 Sep 01 01:13:21 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Delete snapshot completed successfully. Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-092d865a-0cc4-4672-82c4-7135613cb994 tempest-SnapshotsActionsTest-708809949 None] Lock "cinder-cbd32746-5f72-44e0-abf4-c7d5e35dc7a7-delete_snapshot" released by "delete_snapshot" :: held 3.666s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:21 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263" returned: 0 in 0.495s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:21 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263 Sep 01 01:13:21 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:21 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd1b63b2-8dda-4dbd-9bbc-59d353424263" returned: 0 in 0.302s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-cd1b63b2-8dda-4dbd-9bbc-59d353424263" released by "delete_volume" :: held 0.859s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Created reservations ['2870a43e-e7b4-4d20-a1ce-3528f9c0b949', '68ac0100-f279-4e99-9b96-dc3a94929fd6', 'bb2c180e-0919-4c36-b922-800e911a1f9d', '060c47fa-c9ca-4f69-96b6-e66a1ee375df'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "cinder-117f3fbb-679e-429f-a159-692aaeab00c4-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Lock "cinder-117f3fbb-679e-429f-a159-692aaeab00c4-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:22 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:22 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-e32ad37f-0e3a-4803-8da6-092d9d6d958e-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-e32ad37f-0e3a-4803-8da6-092d9d6d958e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-cfbe7ba4-0953-4b76-b944-2055df245cb2" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" acquired by "delete_volume" :: waited 0.048s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaccb1a-277e-49cb-b6cd-f4e13bac0e6b]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-cfbe7ba4-0953-4b76-b944-2055df245cb2" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-e32ad37f-0e3a-4803-8da6-092d9d6d958e" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-e32ad37f-0e3a-4803-8da6-092d9d6d958e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Deleting offline snapshot e32ad37f-0e3a-4803-8da6-092d9d6d958e of volume cfbe7ba4-0953-4b76-b944-2055df245cb2 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] snapshot_file for this snap is: volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce096ce-de9e-4475-b822-aaa4e73ba932]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:22 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 Sep 01 01:13:22 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:22 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.406s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:22 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Deleted volume successfully. Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bee090fe-d6b7-4a3d-a780-8c1fd090d555 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-cd1b63b2-8dda-4dbd-9bbc-59d353424263-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:22 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e Sep 01 01:13:22 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:22 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4" returned: 0 in 0.599s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:23 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4 Sep 01 01:13:23 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:23 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e" returned: 0 in 0.615s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfbe7ba4-0953-4b76-b944-2055df245cb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e735adf1-18a1-4289-8e7b-7a32b71ff033]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:23 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 Sep 01 01:13:23 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:23 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-117f3fbb-679e-429f-a159-692aaeab00c4" returned: 0 in 0.475s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Lock "cinder-quobyte-117f3fbb-679e-429f-a159-692aaeab00c4" released by "delete_volume" :: held 1.166s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Created reservations ['36d6e7d0-f083-41a4-8320-51d5a9536712', '282fadaf-b7dd-4956-956e-86af90df455b', 'b0cedbca-ae9d-4aa2-b4a4-b1cab7ac22a5', 'a120258c-a0f2-4356-8692-e9d87d03fd58'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:23 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:23 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:24 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.348s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:24 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:24 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:24 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Deleted volume successfully. Sep 01 01:13:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2" returned: 0 in 0.915s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-db4f5db9-2643-463e-ab62-f9cb61a20784 tempest-SnapshotsActionsTest-708809949 None] Lock "cinder-117f3fbb-679e-429f-a159-692aaeab00c4-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:24 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e Sep 01 01:13:24 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:24 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e" returned: 0 in 0.692s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:24 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e Sep 01 01:13:24 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:25 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2.e32ad37f-0e3a-4803-8da6-092d9d6d958e" returned: 0 in 0.357s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-e32ad37f-0e3a-4803-8da6-092d9d6d958e" released by "_delete_snapshot" :: held 2.818s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-cfbe7ba4-0953-4b76-b944-2055df245cb2" released by "delete_snapshot" :: held 2.864s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:25 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Created reservations ['f3b1b3dc-0452-4647-aeb4-120d135977a2', '848eca92-e327-4b00-9cfe-dd8fbb95ace5', '89a45ff2-a2e9-468e-9050-65be0e0b8bca', 'a44ea28e-84e4-4147-a6f9-67ec6776410c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:25 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Delete snapshot completed successfully. Sep 01 01:13:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-946f64a5-eefe-4e32-8545-cecfacd47e4a tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-e32ad37f-0e3a-4803-8da6-092d9d6d958e-delete_snapshot" released by "delete_snapshot" :: held 3.183s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-cfbe7ba4-0953-4b76-b944-2055df245cb2-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-cfbe7ba4-0953-4b76-b944-2055df245cb2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-cfbe7ba4-0953-4b76-b944-2055df245cb2" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-cfbe7ba4-0953-4b76-b944-2055df245cb2" acquired by "delete_volume" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:25 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[600efde1-22cf-46b3-94a2-7ea5013f687d]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:26 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 Sep 01 01:13:26 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:26 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2" returned: 0 in 0.617s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:26 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2 Sep 01 01:13:26 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:26 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cfbe7ba4-0953-4b76-b944-2055df245cb2" returned: 0 in 0.416s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-cfbe7ba4-0953-4b76-b944-2055df245cb2" released by "delete_volume" :: held 1.140s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Created reservations ['d3249674-9654-4928-bf5e-f1ae2c973b1e', '02941559-18b2-4af4-8358-59d895cae51e', '325a5899-dc71-45d7-9620-65b4c0d34f64', '6c150e5c-3efd-4849-bc86-75441fe2c469'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Flow 'volume_create_manager' (fdd6f0ec-c08b-4f2b-b162-42e997ac8158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9ffc24-7baa-4403-b562-b92ceaefbb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9ffc24-7baa-4403-b562-b92ceaefbb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1825102134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1653ae48037f4b9b953880e3f4bae740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:27Z,use_quota=True,user_id='d07356809c9345c2a377520392198dc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d534e3-353c-4d16-b387-1b83feb8495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d534e3-353c-4d16-b387-1b83feb8495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f520cf-5fcf-459b-9dc5-53c4ac1bff6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.image.glance [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Creating Keystone auth plugin from conf {{(pid=87064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:27 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:27 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:27 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.333s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:27 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Deleted volume successfully. Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-972422b5-4525-4e7a-93b9-bd3055d78e37 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-cfbe7ba4-0953-4b76-b944-2055df245cb2-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f520cf-5fcf-459b-9dc5-53c4ac1bff6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c', 'volume_name': 'volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c96172d-fc72-4a16-8092-7ea0e1dd89e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c96172d-fc72-4a16-8092-7ea0e1dd89e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff04473b-105e-4109-8f88-1837977d3580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:27 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Volume 7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 01:13:27 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Trying to clone 7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c from image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]). {{(pid=87064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:13:28 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:13:28 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Image download 20.69 MB at 20.69 MB/s Sep 01 01:13:28 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9491d16-6b32-4945-8e2e-d82ed376860e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:28 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD Sep 01 01:13:28 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Flow 'volume_create_manager' (11dcf975-006d-468e-81a9-21d0f9f5b146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117a8fd4-65b8-4b31-8522-84bb0127a4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117a8fd4-65b8-4b31-8522-84bb0127a4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1041709932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7f2c3e-657f-44c1-971e-86022e8f4e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cb634f41f74358a74116f556ee46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:29Z,use_quota=True,user_id='1a5403d405024a6a8c117b4eb2e5023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b548d6-de5d-4a4c-bf9e-5140f1ec2144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b548d6-de5d-4a4c-bf9e-5140f1ec2144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:29 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71373e3-31f6-4688-9d37-b5436bf861f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71373e3-31f6-4688-9d37-b5436bf861f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d7f2c3e-657f-44c1-971e-86022e8f4e78', 'volume_name': 'volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8661aae-6750-407b-b0f7-f66ee7271111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8661aae-6750-407b-b0f7-f66ee7271111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90affef8-b0f3-42f9-bcfe-a420745e6971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:29 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Volume 0d7f2c3e-657f-44c1-971e-86022e8f4e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78', 'volume_size': 1} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1041709932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7f2c3e-657f-44c1-971e-86022e8f4e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cb634f41f74358a74116f556ee46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:29Z,use_quota=True,user_id='1a5403d405024a6a8c117b4eb2e5023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Creating volume 0d7f2c3e-657f-44c1-971e-86022e8f4e78 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:13:29 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Temporary image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 is fetched for user d07356809c9345c2a377520392198dc1. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:13:29 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 1073741824 Sep 01 01:13:29 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[89910436-8357-4155-9310-73b953e1a8cf]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:29 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD Sep 01 01:13:29 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:29 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:29 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 1073741824" returned: 0 in 0.638s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:29 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 Sep 01 01:13:29 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:30 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78" returned: 0 in 0.299s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1825102134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1653ae48037f4b9b953880e3f4bae740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:27Z,use_quota=True,user_id='d07356809c9345c2a377520392198dc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Creating volume 7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:13:30 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90affef8-b0f3-42f9-bcfe-a420745e6971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81bbc0f2-d22b-4a77-9e05-228c31f2c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:30 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c 1073741824 Sep 01 01:13:30 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Volume volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 (0d7f2c3e-657f-44c1-971e-86022e8f4e78): created successfully Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81bbc0f2-d22b-4a77-9e05-228c31f2c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Flow 'volume_create_manager' (11dcf975-006d-468e-81a9-21d0f9f5b146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:30 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-fd913b38-280a-490c-ab88-b073cfb8867e tempest-VolumesSnapshotTestJSON-713433623 None] Created volume successfully. Sep 01 01:13:30 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c 1073741824" returned: 0 in 0.648s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:30 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c Sep 01 01:13:30 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:31 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c" returned: 0 in 0.359s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Attempting download of 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}])) to volume 7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9753f95-9bc0-4eeb-bf4f-19b173e4c3d4]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2t4wkutq {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] Creating offline snapshot 9ebcb189-34e7-4038-9a71-ac19ffffb096 of volume 0d7f2c3e-657f-44c1-971e-86022e8f4e78 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f891e0f-ed10-4a2f-957e-aed112145c90]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:31 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2t4wkutq Sep 01 01:13:31 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:31 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 Sep 01 01:13:31 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:31 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2t4wkutq" returned: 0 in 0.443s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2t4wkutq {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Flow 'volume_create_manager' (5db50062-8d0d-4c10-950c-8b62194855c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d31540-2519-46a8-a6ec-af6b8f5357cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d31540-2519-46a8-a6ec-af6b8f5357cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1996590704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d976d77-9e93-41e3-82df-5651bc2b4035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6f5359f6094ddfa8bb9440f17f78fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:32Z,use_quota=True,user_id='3804da24a34d45159e2157bfadc68eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cb2c95-edec-4865-a7ce-74d6885de88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cb2c95-edec-4865-a7ce-74d6885de88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8e2b71-cc10-40ef-af53-7f1dbccf47ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8e2b71-cc10-40ef-af53-7f1dbccf47ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d976d77-9e93-41e3-82df-5651bc2b4035', 'volume_name': 'volume-3d976d77-9e93-41e3-82df-5651bc2b4035', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d5d1b7-5b3f-4aae-8c4b-9fb01d24a1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d5d1b7-5b3f-4aae-8c4b-9fb01d24a1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:31 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2t4wkutq Sep 01 01:13:31 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b262df04-993a-4815-8695-8e15d96adfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:31 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Volume 3d976d77-9e93-41e3-82df-5651bc2b4035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d976d77-9e93-41e3-82df-5651bc2b4035', 'volume_size': 1} Sep 01 01:13:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:32 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78" returned: 0 in 0.495s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:32 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 1G Sep 01 01:13:32 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:32 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2t4wkutq" returned: 1 in 0.440s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2t4wkutq' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2769e7d2-5386-4e19-8d8d-16e882e8f956]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:32 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD Sep 01 01:13:32 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:32 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 1G" returned: 0 in 0.543s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:32 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 Sep 01 01:13:32 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:32 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 was qcow2, converting to qcow2 {{(pid=87064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:32 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c Sep 01 01:13:32 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Flow 'volume_create_manager' (465acb78-2f93-4814-9fb7-31dfd0a9efa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d613c240-c0c0-458f-84e5-49977e85de36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d613c240-c0c0-458f-84e5-49977e85de36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1297042150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b66a7f-a7f3-4887-953c-c56f1630f6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ae2cb9f6c7457ab8332d074088bba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:33Z,use_quota=True,user_id='26caa3029a86425da64d6f22a63e5695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3ce34bf-71cb-4878-913b-4e87bc129854),volume_type_id=b3ce34bf-71cb-4878-913b-4e87bc129854)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ef1056-0c6e-4a2e-9431-83af9003f314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ef1056-0c6e-4a2e-9431-83af9003f314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd36afa-1f27-424c-9b46-9ce6be24873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd36afa-1f27-424c-9b46-9ce6be24873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b66a7f-a7f3-4887-953c-c56f1630f6b4', 'volume_name': 'volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a234a056-f351-455d-87df-96175676034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a234a056-f351-455d-87df-96175676034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8842c846-68cb-49a1-9436-4b668f49ecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:32 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Volume a1b66a7f-a7f3-4887-953c-c56f1630f6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4', 'volume_size': 1} Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:32 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096" returned: 0 in 0.335s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:32 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 is being set with open permissions: ugo+rw Sep 01 01:13:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:32 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 Sep 01 01:13:32 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:33 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096" returned: 0 in 0.310s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:33 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.info Sep 01 01:13:33 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:33 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.info" returned: 0 in 0.354s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:33 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.info is being set with open permissions: ugo+rw Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:33 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.info Sep 01 01:13:33 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:33 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.info" returned: 0 in 0.297s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.959s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1996590704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d976d77-9e93-41e3-82df-5651bc2b4035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6f5359f6094ddfa8bb9440f17f78fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:32Z,use_quota=True,user_id='3804da24a34d45159e2157bfadc68eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Creating volume 3d976d77-9e93-41e3-82df-5651bc2b4035 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:13:33 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:13:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:33 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035 1073741824 Sep 01 01:13:33 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:33 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-31440f19-a6e6-4ee7-8424-da8dee01beab tempest-VolumesSnapshotTestJSON-713433623 None] Create snapshot completed successfully Sep 01 01:13:34 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035 1073741824" returned: 0 in 0.506s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:34 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035 Sep 01 01:13:34 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:34 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c" returned: 0 in 1.980s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_zgip3dhbdevstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:13:34 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Converted 112.00 MB image at 56.52 MB/s Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:34 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c 1G Sep 01 01:13:34 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:34 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035" returned: 0 in 0.318s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.993s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1297042150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b66a7f-a7f3-4887-953c-c56f1630f6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ae2cb9f6c7457ab8332d074088bba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:33Z,use_quota=True,user_id='26caa3029a86425da64d6f22a63e5695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3ce34bf-71cb-4878-913b-4e87bc129854),volume_type_id=b3ce34bf-71cb-4878-913b-4e87bc129854)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Creating volume a1b66a7f-a7f3-4887-953c-c56f1630f6b4 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:13:34 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:34 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4 1073741824 Sep 01 01:13:34 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b262df04-993a-4815-8695-8e15d96adfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d976d77-9e93-41e3-82df-5651bc2b4035', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dba6f2-ee41-4089-9548-051cbc96c8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:34 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Volume volume-3d976d77-9e93-41e3-82df-5651bc2b4035 (3d976d77-9e93-41e3-82df-5651bc2b4035): created successfully Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dba6f2-ee41-4089-9548-051cbc96c8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Flow 'volume_create_manager' (5db50062-8d0d-4c10-950c-8b62194855c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-bbc620ff-ad35-4a2e-978d-6db1b26c4808 tempest-VolumesListAdminTestJSON-426819381 None] Created volume successfully. Sep 01 01:13:35 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c 1G" returned: 0 in 0.386s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Downloaded image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}])) to volume 7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c successfully. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Temporary image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 for user d07356809c9345c2a377520392198dc1 is deleted. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Marking volume 7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c as bootable. {{(pid=87064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Copying metadata from image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 to 7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c. {{(pid=87064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Creating volume glance metadata for volume 7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c backed by image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff04473b-105e-4109-8f88-1837977d3580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019be9d4-4549-4401-84c3-3b178b2616f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:35 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Volume volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c (7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c): created successfully Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019be9d4-4549-4401-84c3-3b178b2616f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Flow 'volume_create_manager' (fdd6f0ec-c08b-4f2b-b162-42e997ac8158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:35 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-4d47ed05-057e-4e79-89ba-7252ec87f463 tempest-TestShelveInstance-1237028677 None] Created volume successfully. Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:13:35 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Flow 'volume_create_manager' (80e9caf7-8437-443c-b9da-dd2e722a8a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91ce7b6-0abd-497c-8f2d-6fecebbd591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4 1073741824" returned: 0 in 0.610s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91ce7b6-0abd-497c-8f2d-6fecebbd591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1684597825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43673413-7d05-4fde-b847-ccc5cde0d998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cb634f41f74358a74116f556ee46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ebcb189-34e7-4038-9a71-ac19ffffb096,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:35Z,use_quota=True,user_id='1a5403d405024a6a8c117b4eb2e5023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79ee75c-f93d-4255-88f5-1b1ceb0bf78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79ee75c-f93d-4255-88f5-1b1ceb0bf78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad2398a-4ce7-4465-a551-ddda86f6a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad2398a-4ce7-4465-a551-ddda86f6a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '43673413-7d05-4fde-b847-ccc5cde0d998', 'volume_name': 'volume-43673413-7d05-4fde-b847-ccc5cde0d998', 'volume_size': 1, 'snapshot_id': '9ebcb189-34e7-4038-9a71-ac19ffffb096'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721ee7a9-dae4-4a8a-8c67-681d97ff776e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721ee7a9-dae4-4a8a-8c67-681d97ff776e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beacd938-8d27-4e84-85dc-4939c01dee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:35 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Volume 43673413-7d05-4fde-b847-ccc5cde0d998: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-43673413-7d05-4fde-b847-ccc5cde0d998', 'volume_size': 1, 'snapshot_id': '9ebcb189-34e7-4038-9a71-ac19ffffb096'} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:35 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4 Sep 01 01:13:35 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:35 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4" returned: 0 in 0.271s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.290s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-9ebcb189-34e7-4038-9a71-ac19ffffb096-43673413-7d05-4fde-b847-ccc5cde0d998" by "_create_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8842c846-68cb-49a1-9436-4b668f49ecc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b23e77-1a69-4f30-ab64-540ed4b76bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-9ebcb189-34e7-4038-9a71-ac19ffffb096-43673413-7d05-4fde-b847-ccc5cde0d998" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Creating volume 43673413-7d05-4fde-b847-ccc5cde0d998 from snapshot 9ebcb189-34e7-4038-9a71-ac19ffffb096 {{(pid=87064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-43673413-7d05-4fde-b847-ccc5cde0d998" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:35 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Volume volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4 (a1b66a7f-a7f3-4887-953c-c56f1630f6b4): created successfully Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b23e77-1a69-4f30-ab64-540ed4b76bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Flow 'volume_create_manager' (465acb78-2f93-4814-9fb7-31dfd0a9efa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-43673413-7d05-4fde-b847-ccc5cde0d998" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] snapshot: 9ebcb189-34e7-4038-9a71-ac19ffffb096, volume: 43673413-7d05-4fde-b847-ccc5cde0d998, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:13:35 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-936deb51-f469-4466-91b5-3ad4b150c30c tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Created volume successfully. Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9253e8-8b06-4493-a60d-a7c74d469495]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:36 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 Sep 01 01:13:36 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:36 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096" returned: 0 in 0.507s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc41734-74e4-426a-a488-cd5ee964f3dc]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:13:36 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 Sep 01 01:13:36 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Flow 'volume_create_manager' (3f462f2c-7638-4f27-bb54-0a973aaee544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1687268e-c3c9-44bb-aa65-444eaea0d9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1687268e-c3c9-44bb-aa65-444eaea0d9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-748622666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce765c7-4b32-4ae0-8b3e-e942f099b21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6f5359f6094ddfa8bb9440f17f78fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:37Z,use_quota=True,user_id='3804da24a34d45159e2157bfadc68eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0bdd21-c2aa-47c7-9a6d-ffb7732e2895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0bdd21-c2aa-47c7-9a6d-ffb7732e2895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dded89f1-742a-4030-927f-6f4f73dde38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dded89f1-742a-4030-927f-6f4f73dde38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce765c7-4b32-4ae0-8b3e-e942f099b21b', 'volume_name': 'volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8903ad8e-4001-4c35-ac6b-d46762130a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8903ad8e-4001-4c35-ac6b-d46762130a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27476a82-06fc-4607-92a2-17ce5b4bb016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:36 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Volume 0ce765c7-4b32-4ae0-8b3e-e942f099b21b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b', 'volume_size': 1} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:36 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78" returned: 0 in 0.429s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998 not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:13:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:36 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998 Sep 01 01:13:36 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bfeab6d-ffed-4d1e-bd1c-2f97738b9290 tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bfeab6d-ffed-4d1e-bd1c-2f97738b9290 tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:37 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5bfeab6d-ffed-4d1e-bd1c-2f97738b9290 tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:37 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5bfeab6d-ffed-4d1e-bd1c-2f97738b9290 tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bfeab6d-ffed-4d1e-bd1c-2f97738b9290 tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5bfeab6d-ffed-4d1e-bd1c-2f97738b9290 tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:37 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:37 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:38 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5bfeab6d-ffed-4d1e-bd1c-2f97738b9290 tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.700s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:38 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-5bfeab6d-ffed-4d1e-bd1c-2f97738b9290 tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:38 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5bfeab6d-ffed-4d1e-bd1c-2f97738b9290 tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Retype volume completed successfully. Sep 01 01:13:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Acquiring lock "cinder-a1b66a7f-a7f3-4887-953c-c56f1630f6b4-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "cinder-a1b66a7f-a7f3-4887-953c-c56f1630f6b4-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Acquiring lock "cinder-quobyte-a1b66a7f-a7f3-4887-953c-c56f1630f6b4" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "cinder-quobyte-a1b66a7f-a7f3-4887-953c-c56f1630f6b4" acquired by "delete_volume" :: waited 0.055s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:39 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7636cd0c-1e35-49ac-ac3e-4dafdc7d5593]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:40 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4 Sep 01 01:13:40 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:40 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4" returned: 0 in 1.237s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:41 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4 Sep 01 01:13:41 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:41 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a1b66a7f-a7f3-4887-953c-c56f1630f6b4" returned: 0 in 0.780s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "cinder-quobyte-a1b66a7f-a7f3-4887-953c-c56f1630f6b4" released by "delete_volume" :: held 2.149s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:41 devstack cinder-volume[87064]: WARNING cinder.quota [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:13:41 devstack cinder-volume[87064]: WARNING cinder.quota [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:13:42 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Created reservations ['f8b7010d-d0c6-4e9d-8644-047be27c33ee', 'fbe9d88b-752a-4a0a-853e-a9fd214a8662', 'ea10d929-4e37-4684-8045-c1358d8a95bd', '8a1d39e5-aca8-48c8-baf3-e14103e0534c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:42 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:42 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-888c1a8c-5539-4cb4-a1b8-bd164f04ea52 req-ebe3791f-36ab-4305-8a79-9bfee886b228 tempest-TestShelveInstance-1237028677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:43 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.698s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:43 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:43 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Deleted volume successfully. Sep 01 01:13:43 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=140,cinder:INSERT=42,cinder:UPDATE=145,cinder:DELETE=16 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:13:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b5cba3c7-1a41-40b1-98f0-118cdf413f0f tempest-VolumeRetypeWithoutMigrationTest-1131757941 None] Lock "cinder-a1b66a7f-a7f3-4887-953c-c56f1630f6b4-delete_volume" released by "delete_volume" :: held 3.674s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:43 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998" returned: 0 in 6.654s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:43 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:13:43 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Converted 1024.00 MB image at 153.87 MB/s Sep 01 01:13:43 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998 is being set with open permissions: ugo+rw Sep 01 01:13:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:43 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998 Sep 01 01:13:43 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:43 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998" returned: 0 in 0.326s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-43673413-7d05-4fde-b847-ccc5cde0d998" released by "_copy_volume_from_snapshot" :: held 8.040s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-9ebcb189-34e7-4038-9a71-ac19ffffb096-43673413-7d05-4fde-b847-ccc5cde0d998" released by "_create_volume_from_snapshot" :: held 8.154s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.197s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.289s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-748622666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce765c7-4b32-4ae0-8b3e-e942f099b21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6f5359f6094ddfa8bb9440f17f78fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:37Z,use_quota=True,user_id='3804da24a34d45159e2157bfadc68eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Creating volume 0ce765c7-4b32-4ae0-8b3e-e942f099b21b {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:13:44 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:44 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b 1073741824 Sep 01 01:13:44 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beacd938-8d27-4e84-85dc-4939c01dee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43673413-7d05-4fde-b847-ccc5cde0d998', 'volume_size': 1, 'snapshot_id': '9ebcb189-34e7-4038-9a71-ac19ffffb096'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3398ba7-2729-4612-99ee-00f87032d2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:44 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Volume volume-43673413-7d05-4fde-b847-ccc5cde0d998 (43673413-7d05-4fde-b847-ccc5cde0d998): created successfully Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3398ba7-2729-4612-99ee-00f87032d2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Flow 'volume_create_manager' (80e9caf7-8437-443c-b9da-dd2e722a8a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:44 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-975c6784-a8e8-4f1e-b9a7-22b24c0fa0dc tempest-VolumesSnapshotTestJSON-713433623 None] Created volume successfully. Sep 01 01:13:44 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b 1073741824" returned: 0 in 0.788s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:44 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b Sep 01 01:13:44 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-43673413-7d05-4fde-b847-ccc5cde0d998-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-43673413-7d05-4fde-b847-ccc5cde0d998-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-43673413-7d05-4fde-b847-ccc5cde0d998" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-43673413-7d05-4fde-b847-ccc5cde0d998" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9e547d-affe-46c0-94b2-89f85abde8bb]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:45 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998 Sep 01 01:13:45 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:45 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b" returned: 0 in 0.505s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-888c1a8c-5539-4cb4-a1b8-bd164f04ea52 req-ebe3791f-36ab-4305-8a79-9bfee886b228 tempest-TestShelveInstance-1237028677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.700s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27476a82-06fc-4607-92a2-17ce5b4bb016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa805937-37d3-4aff-b506-8cc3e99e0f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-888c1a8c-5539-4cb4-a1b8-bd164f04ea52 req-ebe3791f-36ab-4305-8a79-9bfee886b228 tempest-TestShelveInstance-1237028677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:45 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Volume volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b (0ce765c7-4b32-4ae0-8b3e-e942f099b21b): created successfully Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa805937-37d3-4aff-b506-8cc3e99e0f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Flow 'volume_create_manager' (3f462f2c-7638-4f27-bb54-0a973aaee544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-4a2a8250-d998-4d15-ab84-2de3d3174d7e tempest-VolumesListAdminTestJSON-426819381 None] Created volume successfully. Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-888c1a8c-5539-4cb4-a1b8-bd164f04ea52 req-ebe3791f-36ab-4305-8a79-9bfee886b228 tempest-TestShelveInstance-1237028677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1da774d6-2295-41a0-bbf3-f81d90207ead', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:13:45 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998" returned: 0 in 0.573s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-888c1a8c-5539-4cb4-a1b8-bd164f04ea52 req-ebe3791f-36ab-4305-8a79-9bfee886b228 tempest-TestShelveInstance-1237028677 None] attachment_update completed successfully. Sep 01 01:13:45 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998 Sep 01 01:13:45 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:46 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-43673413-7d05-4fde-b847-ccc5cde0d998" returned: 0 in 0.590s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-43673413-7d05-4fde-b847-ccc5cde0d998" released by "delete_volume" :: held 1.249s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Created reservations ['ee5efb9e-5954-462f-bb27-b87ccf584114', 'e435dc4f-52c7-49f2-b644-e2660c28a570', 'd9bad107-d120-433d-bacb-c88a5cde65d2', 'd0c61e16-0109-4e1e-95d2-665a91af40e8'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:46 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:46 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:46 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.400s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:46 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Deleted volume successfully. Sep 01 01:13:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-404a378b-cb4a-4a7b-b731-a30e2c1167f8 tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-43673413-7d05-4fde-b847-ccc5cde0d998-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Flow 'volume_create_manager' (12d7139f-c5f2-4d51-973a-5ac1875c1ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b4b689-6aa2-445b-94fc-0b7d597934ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b4b689-6aa2-445b-94fc-0b7d597934ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-24496972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2923141-7627-4f23-bac2-59d1dc8ad7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6f5359f6094ddfa8bb9440f17f78fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:47Z,use_quota=True,user_id='3804da24a34d45159e2157bfadc68eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af81c71-c0ae-4b42-a962-d734f33fd3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af81c71-c0ae-4b42-a962-d734f33fd3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0933eec-22fc-4ea4-acd6-29d5379b771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0933eec-22fc-4ea4-acd6-29d5379b771c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2923141-7627-4f23-bac2-59d1dc8ad7e9', 'volume_name': 'volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6c3ff8-4ab9-471f-995d-1f050c62dfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6c3ff8-4ab9-471f-995d-1f050c62dfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90b6dfe-4649-4382-9cab-9832269ae087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:47 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Volume f2923141-7627-4f23-bac2-59d1dc8ad7e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9', 'volume_size': 1} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-24496972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2923141-7627-4f23-bac2-59d1dc8ad7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6f5359f6094ddfa8bb9440f17f78fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:47Z,use_quota=True,user_id='3804da24a34d45159e2157bfadc68eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Creating volume f2923141-7627-4f23-bac2-59d1dc8ad7e9 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:13:47 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:47 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9 1073741824 Sep 01 01:13:47 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-9ebcb189-34e7-4038-9a71-ac19ffffb096-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-9ebcb189-34e7-4038-9a71-ac19ffffb096-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-0d7f2c3e-657f-44c1-971e-86022e8f4e78" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-0d7f2c3e-657f-44c1-971e-86022e8f4e78" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-9ebcb189-34e7-4038-9a71-ac19ffffb096" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-9ebcb189-34e7-4038-9a71-ac19ffffb096" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Deleting offline snapshot 9ebcb189-34e7-4038-9a71-ac19ffffb096 of volume 0d7f2c3e-657f-44c1-971e-86022e8f4e78 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] snapshot_file for this snap is: volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baab73f-8cef-4b94-9af3-bb2ef17570a2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:47 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 Sep 01 01:13:47 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:48 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9 1073741824" returned: 0 in 0.738s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:48 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9 Sep 01 01:13:48 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:48 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096" returned: 0 in 0.529s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d64064-daa4-4d87-8fa8-d438dd868b1c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:48 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9" returned: 0 in 0.419s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:48 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 Sep 01 01:13:48 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90b6dfe-4649-4382-9cab-9832269ae087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ea1d70-aada-47c5-a764-53032cca1801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:48 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Volume volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9 (f2923141-7627-4f23-bac2-59d1dc8ad7e9): created successfully Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ea1d70-aada-47c5-a764-53032cca1801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:48 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Flow 'volume_create_manager' (12d7139f-c5f2-4d51-973a-5ac1875c1ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:48 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-05d717d3-f427-4d59-aa7b-0db9396b9856 tempest-VolumesListAdminTestJSON-426819381 None] Created volume successfully. Sep 01 01:13:49 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78" returned: 0 in 1.044s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:49 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 Sep 01 01:13:49 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096" returned: 0 in 0.909s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:50 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:50 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096 Sep 01 01:13:50 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:50 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78.9ebcb189-34e7-4038-9a71-ac19ffffb096" returned: 0 in 0.426s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:50 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=153,cinder:INSERT=45,cinder:UPDATE=155,cinder:DELETE=9 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:13:50 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-9ebcb189-34e7-4038-9a71-ac19ffffb096" released by "_delete_snapshot" :: held 3.092s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:50 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-0d7f2c3e-657f-44c1-971e-86022e8f4e78" released by "delete_snapshot" :: held 3.134s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:50 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Created reservations ['3607072a-9590-4700-975b-8b991e0ee629', 'ba5cb0a9-b207-482b-ab2a-1e7105c08d44', '183b05cf-4ef0-48ec-8465-dbf423077800', '6a7826d6-c71b-41b6-9229-f095c0cacc9e'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:51 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Delete snapshot completed successfully. Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0cc80227-009c-4f0a-b828-2bbac119503f tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-9ebcb189-34e7-4038-9a71-ac19ffffb096-delete_snapshot" released by "delete_snapshot" :: held 3.487s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Flow 'volume_create_manager' (049b3851-747f-41da-ad52-58c61a8c92ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e652943-2afc-4b3f-8567-273784414ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e652943-2afc-4b3f-8567-273784414ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcebc5b5-30b4-4d54-8f78-241d906176ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37d14469e704c4bb0fb0d4d6b1df6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:51Z,use_quota=True,user_id='9a71fdf668ad4fbb93016ed1f9c414d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca6f621-a538-41a6-a060-7a2be1e6c307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca6f621-a538-41a6-a060-7a2be1e6c307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15f562c-e10a-4c38-bca9-91236e7e0526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15f562c-e10a-4c38-bca9-91236e7e0526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcebc5b5-30b4-4d54-8f78-241d906176ba', 'volume_name': 'volume-bcebc5b5-30b4-4d54-8f78-241d906176ba', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985068a3-c884-4d5a-a278-e9ee5e710dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985068a3-c884-4d5a-a278-e9ee5e710dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906251a8-7c63-4d3b-a96d-eb62723e30e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:51 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Volume bcebc5b5-30b4-4d54-8f78-241d906176ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcebc5b5-30b4-4d54-8f78-241d906176ba', 'volume_size': 1} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcebc5b5-30b4-4d54-8f78-241d906176ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37d14469e704c4bb0fb0d4d6b1df6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:13:51Z,use_quota=True,user_id='9a71fdf668ad4fbb93016ed1f9c414d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Creating volume bcebc5b5-30b4-4d54-8f78-241d906176ba {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:13:51 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:13:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:51 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba 1073741824 Sep 01 01:13:51 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-0d7f2c3e-657f-44c1-971e-86022e8f4e78-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-0d7f2c3e-657f-44c1-971e-86022e8f4e78-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:52 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba 1073741824" returned: 0 in 0.897s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-0d7f2c3e-657f-44c1-971e-86022e8f4e78" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-0d7f2c3e-657f-44c1-971e-86022e8f4e78" acquired by "delete_volume" :: waited 0.054s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:52 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba Sep 01 01:13:52 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcfbe77-c53b-48b8-ad78-a878fa012df7]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:52 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:52 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:52 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 Sep 01 01:13:52 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:52 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba" returned: 0 in 0.411s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906251a8-7c63-4d3b-a96d-eb62723e30e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcebc5b5-30b4-4d54-8f78-241d906176ba', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3050d825-4187-4314-be83-ce5e208ab4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:13:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Volume volume-bcebc5b5-30b4-4d54-8f78-241d906176ba (bcebc5b5-30b4-4d54-8f78-241d906176ba): created successfully Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3050d825-4187-4314-be83-ce5e208ab4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:13:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Flow 'volume_create_manager' (049b3851-747f-41da-ad52-58c61a8c92ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:13:53 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e8bbd49a-b8f5-4393-a5fd-3b7d203e6c7e tempest-VolumesListAdminTestJSON-1431100955 None] Created volume successfully. Sep 01 01:13:53 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.581s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:13:53 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78" returned: 0 in 1.025s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:53 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78 Sep 01 01:13:53 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Acquiring lock "cinder-bcebc5b5-30b4-4d54-8f78-241d906176ba-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Lock "cinder-bcebc5b5-30b4-4d54-8f78-241d906176ba-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Acquiring lock "cinder-quobyte-bcebc5b5-30b4-4d54-8f78-241d906176ba" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Lock "cinder-quobyte-bcebc5b5-30b4-4d54-8f78-241d906176ba" acquired by "delete_volume" :: waited 0.053s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "cinder-f2923141-7627-4f23-bac2-59d1dc8ad7e9-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf4e73c-7c08-48e6-b97a-19e08cf9da3e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-f2923141-7627-4f23-bac2-59d1dc8ad7e9-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:54 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d7f2c3e-657f-44c1-971e-86022e8f4e78" returned: 0 in 0.520s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-0d7f2c3e-657f-44c1-971e-86022e8f4e78" released by "delete_volume" :: held 1.712s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "cinder-quobyte-f2923141-7627-4f23-bac2-59d1dc8ad7e9" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-quobyte-f2923141-7627-4f23-bac2-59d1dc8ad7e9" acquired by "delete_volume" :: waited 0.046s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:54 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba Sep 01 01:13:54 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[63869b69-162b-4782-87af-55bf25b5aa36]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Created reservations ['799014fc-7f4d-4ab3-b95b-a719de68dfa5', '211da567-9ce8-4ca2-9272-90a0f5c12b44', '084104ac-b7a1-4b14-9980-a2d440bfba61', 'ef40a9e8-393b-47e4-bc58-f5bb61f50d8a'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:54 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:54 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:54 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9 Sep 01 01:13:54 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:54 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba" returned: 0 in 0.872s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:54 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba Sep 01 01:13:54 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-b623891a-8767-421d-8eef-23cd3d8c23a9-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-b623891a-8767-421d-8eef-23cd3d8c23a9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "cinder-quobyte-b623891a-8767-421d-8eef-23cd3d8c23a9" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-b623891a-8767-421d-8eef-23cd3d8c23a9" acquired by "delete_volume" :: waited 0.040s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb7e4ec-5098-4ce9-8693-91f5039a0d83]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:55 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.899s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Deleted volume successfully. Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2aa5ba97-e694-4e45-8c2b-b34f5fa6695d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-0d7f2c3e-657f-44c1-971e-86022e8f4e78-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:55 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 Sep 01 01:13:55 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:55 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bcebc5b5-30b4-4d54-8f78-241d906176ba" returned: 0 in 0.884s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Lock "cinder-quobyte-bcebc5b5-30b4-4d54-8f78-241d906176ba" released by "delete_volume" :: held 1.860s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:55 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9" returned: 0 in 1.480s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:55 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9 Sep 01 01:13:55 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:55 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Created reservations ['2e9bd7db-d646-4af5-8754-706432a86feb', 'e49accf2-2804-468e-87ab-1a33897147f9', 'f0e46f15-0f47-42e1-b5af-e0dedc67a809', '1ec924af-1e6e-4f6d-ab09-07b39722375e'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:56 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:56 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:56 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9" returned: 0 in 0.915s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:56 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9 Sep 01 01:13:56 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:56 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2923141-7627-4f23-bac2-59d1dc8ad7e9" returned: 0 in 0.724s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-quobyte-f2923141-7627-4f23-bac2-59d1dc8ad7e9" released by "delete_volume" :: held 2.349s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Created reservations ['d6d246d2-ac43-46a4-a974-35029edb7f7e', 'ff0f2782-ea3e-44d1-92d4-6ba7542e7eee', '6bf224f2-dfc9-4728-86fa-109ad02d903a', 'ce999381-ad7c-40ff-b4fa-129a70f3c482'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:56 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.612s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:56 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Deleted volume successfully. Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d8c45c64-212e-4f9c-b917-f9870c8f8923 tempest-VolumesListAdminTestJSON-1431100955 None] Lock "cinder-bcebc5b5-30b4-4d54-8f78-241d906176ba-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:56 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:56 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:57 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b623891a-8767-421d-8eef-23cd3d8c23a9" returned: 0 in 0.712s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-quobyte-b623891a-8767-421d-8eef-23cd3d8c23a9" released by "delete_volume" :: held 1.778s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Created reservations ['df226c26-3136-4bd0-a177-3c09eaff572e', '1d2daeb3-393f-4884-94f4-e2f0e216b399', 'c3b48e9f-25f9-48b2-866c-7bf0ff14114e', 'f3644566-36cb-4987-b4ae-583f09e79748'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:57 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:57 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:57 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.687s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Deleted volume successfully. Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-08313109-321e-4c82-802e-4d96b41422aa tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-f2923141-7627-4f23-bac2-59d1dc8ad7e9-delete_volume" released by "delete_volume" :: held 3.623s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:57 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.532s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:13:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Deleted volume successfully. Sep 01 01:13:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d063c5c2-fca7-4043-a7bf-926848757e1d tempest-VolumesSnapshotTestJSON-713433623 None] Lock "cinder-b623891a-8767-421d-8eef-23cd3d8c23a9-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "cinder-0ce765c7-4b32-4ae0-8b3e-e942f099b21b-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-0ce765c7-4b32-4ae0-8b3e-e942f099b21b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "cinder-quobyte-0ce765c7-4b32-4ae0-8b3e-e942f099b21b" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:13:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-quobyte-0ce765c7-4b32-4ae0-8b3e-e942f099b21b" acquired by "delete_volume" :: waited 0.016s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:13:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02171e8-badd-4f68-b863-e5eb1b5beb23]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:13:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:58 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b Sep 01 01:13:58 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:58 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b" returned: 0 in 0.769s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:59 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b Sep 01 01:13:59 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:13:59 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Sep 01 01:13:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0ce765c7-4b32-4ae0-8b3e-e942f099b21b" returned: 0 in 0.495s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:13:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-quobyte-0ce765c7-4b32-4ae0-8b3e-e942f099b21b" released by "delete_volume" :: held 1.335s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:13:59 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Created reservations ['9970ac1d-1d20-4d81-8baa-bfb3f194d352', '5f50d8af-a8e5-4be3-af5a-b2e5d33be8e4', '57c0ed26-a1b6-448a-b855-0ee99919f0ac', 'b7eeebb8-bec6-4145-aa35-fd203b8e5b56'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:13:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:13:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:13:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:13:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:13:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:13:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:13:59 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:13:59 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:00 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.484s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:00 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:14:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Deleted volume successfully. Sep 01 01:14:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0d69329d-5578-48d9-814e-1487cf7bd341 tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-0ce765c7-4b32-4ae0-8b3e-e942f099b21b-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "cinder-3d976d77-9e93-41e3-82df-5651bc2b4035-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-3d976d77-9e93-41e3-82df-5651bc2b4035-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "cinder-quobyte-3d976d77-9e93-41e3-82df-5651bc2b4035" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-quobyte-3d976d77-9e93-41e3-82df-5651bc2b4035" acquired by "delete_volume" :: waited 0.047s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[576fb5cf-7162-433d-a506-3393c6c92f01]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:14:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:01 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035 Sep 01 01:14:01 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Flow 'volume_create_manager' (3c3dad6e-056d-49e9-a346-c063baf0862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e811f8-e13d-46e0-8522-0e1040b51488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e811f8-e13d-46e0-8522-0e1040b51488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-721822276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e962e882-c7e2-4c69-a3f5-15a466d77802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2949095f2eaf4099ba004be7cee196f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:01Z,use_quota=True,user_id='d69951d6659b4fae91720e35c3a31aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a97e5a-5a67-45c3-bad9-3da1b7b4f879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a97e5a-5a67-45c3-bad9-3da1b7b4f879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030b2ba3-a2f2-454f-a802-9474a105baeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030b2ba3-a2f2-454f-a802-9474a105baeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e962e882-c7e2-4c69-a3f5-15a466d77802', 'volume_name': 'volume-e962e882-c7e2-4c69-a3f5-15a466d77802', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c7c28d-e69a-4291-b275-26479dcd5bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c7c28d-e69a-4291-b275-26479dcd5bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd00e16-3c62-4a87-9228-de6b0b5330d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:01 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Volume e962e882-c7e2-4c69-a3f5-15a466d77802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e962e882-c7e2-4c69-a3f5-15a466d77802', 'volume_size': 1} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-721822276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e962e882-c7e2-4c69-a3f5-15a466d77802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2949095f2eaf4099ba004be7cee196f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:01Z,use_quota=True,user_id='d69951d6659b4fae91720e35c3a31aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Creating volume e962e882-c7e2-4c69-a3f5-15a466d77802 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:14:01 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:01 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802 1073741824 Sep 01 01:14:01 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:01 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035" returned: 0 in 0.726s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:01 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035 Sep 01 01:14:01 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:02 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3d976d77-9e93-41e3-82df-5651bc2b4035" returned: 0 in 0.314s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-quobyte-3d976d77-9e93-41e3-82df-5651bc2b4035" released by "delete_volume" :: held 1.105s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:02 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802 1073741824" returned: 0 in 0.563s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Created reservations ['1575dbe3-8137-4c18-a3bc-69d823ed0e1d', '3bee4950-fa04-4f17-be1c-9bf816afc54d', '247350b4-9a4d-4570-bc07-63e499a2cb70', 'ef5bd934-d869-4149-896c-9989f3c74095'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:14:02 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802 Sep 01 01:14:02 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:02 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:14:02 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:02 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802" returned: 0 in 0.408s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd00e16-3c62-4a87-9228-de6b0b5330d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e962e882-c7e2-4c69-a3f5-15a466d77802', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8890a91-af6f-4593-a3c4-13c99fbc191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:02 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Volume volume-e962e882-c7e2-4c69-a3f5-15a466d77802 (e962e882-c7e2-4c69-a3f5-15a466d77802): created successfully Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8890a91-af6f-4593-a3c4-13c99fbc191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Flow 'volume_create_manager' (3c3dad6e-056d-49e9-a346-c063baf0862b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c0171333-fb99-413d-a4ac-842217ff8c60 tempest-VolumesTransfersV355Test-50643204 None] Created volume successfully. Sep 01 01:14:02 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.363s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:14:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Deleted volume successfully. Sep 01 01:14:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d56ed209-4d6a-436a-8105-fe07462604d2 tempest-VolumesListAdminTestJSON-426819381 None] Lock "cinder-3d976d77-9e93-41e3-82df-5651bc2b4035-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:04 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e36e0865-42a4-4320-889b-ae42767e84d5 tempest-VolumesTransfersV355Test-128375732 None] Transfer volume completed successfully. Sep 01 01:14:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Acquiring lock "cinder-e962e882-c7e2-4c69-a3f5-15a466d77802-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Lock "cinder-e962e882-c7e2-4c69-a3f5-15a466d77802-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Acquiring lock "cinder-quobyte-e962e882-c7e2-4c69-a3f5-15a466d77802" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Lock "cinder-quobyte-e962e882-c7e2-4c69-a3f5-15a466d77802" acquired by "delete_volume" :: waited 0.030s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:05 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[90784cab-b000-494a-8865-135f0f68fcaa]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:14:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:06 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802 Sep 01 01:14:06 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:06 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802" returned: 0 in 0.700s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:06 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802 Sep 01 01:14:06 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:07 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e962e882-c7e2-4c69-a3f5-15a466d77802" returned: 0 in 0.359s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Lock "cinder-quobyte-e962e882-c7e2-4c69-a3f5-15a466d77802" released by "delete_volume" :: held 1.124s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Created reservations ['05ce825e-823e-4683-926f-20df3b716be4', '7d1fa101-389b-480f-87bb-b79da51a7c3e', 'cb7588f1-f9be-4d13-9cc1-e3756b4e0c41', '2a50da09-835d-475d-86ad-d9e3996dfb91'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:07 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:14:07 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:07 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.364s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:14:07 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Deleted volume successfully. Sep 01 01:14:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4bebc396-ab4f-4d8b-b798-deee897f2b96 tempest-VolumesTransfersV355Test-1990360363 None] Lock "cinder-e962e882-c7e2-4c69-a3f5-15a466d77802-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Flow 'volume_create_manager' (bea42259-83a5-4170-bf2a-d52c57fce869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2070af56-1b42-4708-8c4d-b6310c4b70b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2070af56-1b42-4708-8c4d-b6310c4b70b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-487210829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794ab331-34f1-4f65-af07-8b69fa61d279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2949095f2eaf4099ba004be7cee196f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:09Z,use_quota=True,user_id='d69951d6659b4fae91720e35c3a31aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23d3d7-8564-4775-be3f-c610bf28ccd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23d3d7-8564-4775-be3f-c610bf28ccd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c71acf-b90e-43d7-8405-7180a42c25cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c71acf-b90e-43d7-8405-7180a42c25cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794ab331-34f1-4f65-af07-8b69fa61d279', 'volume_name': 'volume-794ab331-34f1-4f65-af07-8b69fa61d279', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de81605c-7929-4c87-ba10-112f8e6772b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de81605c-7929-4c87-ba10-112f8e6772b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b04684-7745-4c31-aed1-e8dd1d06b991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:09 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Volume 794ab331-34f1-4f65-af07-8b69fa61d279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794ab331-34f1-4f65-af07-8b69fa61d279', 'volume_size': 1} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-487210829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794ab331-34f1-4f65-af07-8b69fa61d279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2949095f2eaf4099ba004be7cee196f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:09Z,use_quota=True,user_id='d69951d6659b4fae91720e35c3a31aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Creating volume 794ab331-34f1-4f65-af07-8b69fa61d279 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:14:09 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:09 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279 1073741824 Sep 01 01:14:09 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279 1073741824" returned: 0 in 0.772s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:09 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:10 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279 Sep 01 01:14:10 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:10 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279" returned: 0 in 0.378s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b04684-7745-4c31-aed1-e8dd1d06b991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794ab331-34f1-4f65-af07-8b69fa61d279', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645335c3-bbed-4d0d-8421-816dc3d2df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:10 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Volume volume-794ab331-34f1-4f65-af07-8b69fa61d279 (794ab331-34f1-4f65-af07-8b69fa61d279): created successfully Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645335c3-bbed-4d0d-8421-816dc3d2df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Flow 'volume_create_manager' (bea42259-83a5-4170-bf2a-d52c57fce869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:10 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c8da68bf-0e6a-4e04-a89d-2d1cc258b5fe tempest-VolumesTransfersV355Test-50643204 None] Created volume successfully. Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Flow 'volume_create_manager' (5af19169-835d-4617-b7ce-8e1664699440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8f1f37-d03d-4bd8-89f3-a2bddd0cbe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8f1f37-d03d-4bd8-89f3-a2bddd0cbe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1125279656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd16be29-935f-4fc3-8498-43742374d0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07925f9d9c8147318d93fe194b16d0ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:11Z,use_quota=True,user_id='e4e112eb44164574ba2d4c5d1a94f5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a6710e-17ad-4eaf-9a0d-9da37d7ed425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a6710e-17ad-4eaf-9a0d-9da37d7ed425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e7f258-c988-4e97-9300-26d039ae62f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e7f258-c988-4e97-9300-26d039ae62f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd16be29-935f-4fc3-8498-43742374d0de', 'volume_name': 'volume-cd16be29-935f-4fc3-8498-43742374d0de', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ff387b-428d-4b6d-b3e8-caec015bfbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ff387b-428d-4b6d-b3e8-caec015bfbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd49ad9-82a3-402e-b734-7033012cd54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:11 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Volume cd16be29-935f-4fc3-8498-43742374d0de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd16be29-935f-4fc3-8498-43742374d0de', 'volume_size': 1} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1125279656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd16be29-935f-4fc3-8498-43742374d0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07925f9d9c8147318d93fe194b16d0ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:11Z,use_quota=True,user_id='e4e112eb44164574ba2d4c5d1a94f5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Creating volume cd16be29-935f-4fc3-8498-43742374d0de {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:14:11 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:11 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de 1073741824 Sep 01 01:14:11 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Acquiring lock "cinder-794ab331-34f1-4f65-af07-8b69fa61d279-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Lock "cinder-794ab331-34f1-4f65-af07-8b69fa61d279-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Acquiring lock "cinder-quobyte-794ab331-34f1-4f65-af07-8b69fa61d279" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Lock "cinder-quobyte-794ab331-34f1-4f65-af07-8b69fa61d279" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[75018672-6447-4013-8359-4be1f6f6046f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:11 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de 1073741824" returned: 0 in 0.802s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:11 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279 Sep 01 01:14:11 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:11 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de Sep 01 01:14:11 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:12 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de" returned: 0 in 0.320s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd49ad9-82a3-402e-b734-7033012cd54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd16be29-935f-4fc3-8498-43742374d0de', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511e96ca-0e95-4de6-a969-be3ed3b2adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:12 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279" returned: 0 in 0.514s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:12 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Volume volume-cd16be29-935f-4fc3-8498-43742374d0de (cd16be29-935f-4fc3-8498-43742374d0de): created successfully Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511e96ca-0e95-4de6-a969-be3ed3b2adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Flow 'volume_create_manager' (5af19169-835d-4617-b7ce-8e1664699440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:12 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279 Sep 01 01:14:12 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6d27f80d-7551-4bfc-93b1-1510f5d90c77 tempest-VolumesMetadataTest-1101204742 None] Created volume successfully. Sep 01 01:14:12 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:12 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-794ab331-34f1-4f65-af07-8b69fa61d279" returned: 0 in 0.365s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Lock "cinder-quobyte-794ab331-34f1-4f65-af07-8b69fa61d279" released by "delete_volume" :: held 0.938s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Created reservations ['53e717ef-1299-48e1-97c0-bc8cff82aae0', 'a492fa63-ab2f-4b7e-9dde-716c8eb06831', '4e1b3043-be8c-4af1-8994-80d52dcf7dd6', '8ff92de0-3efd-4087-a576-085723ed54c5'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:12 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:14:12 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:13 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.310s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:13 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:14:13 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Deleted volume successfully. Sep 01 01:14:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-63b62239-cd0e-4c92-907f-2d69e7ae151a tempest-VolumesTransfersV355Test-1990360363 None] Lock "cinder-794ab331-34f1-4f65-af07-8b69fa61d279-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Acquiring lock "cinder-cd16be29-935f-4fc3-8498-43742374d0de-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Lock "cinder-cd16be29-935f-4fc3-8498-43742374d0de-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Acquiring lock "cinder-quobyte-cd16be29-935f-4fc3-8498-43742374d0de" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Lock "cinder-quobyte-cd16be29-935f-4fc3-8498-43742374d0de" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:14 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cc5aa9-a32f-4c20-be8d-d97140ff99a2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:14:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:14 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de Sep 01 01:14:14 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:14 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de" returned: 0 in 0.531s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:14 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de Sep 01 01:14:14 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:15 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cd16be29-935f-4fc3-8498-43742374d0de" returned: 0 in 0.320s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Lock "cinder-quobyte-cd16be29-935f-4fc3-8498-43742374d0de" released by "delete_volume" :: held 0.920s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Created reservations ['4b522c35-55b6-42c9-8cca-4240db92d8df', 'fcfd244e-4946-4dcb-8e99-ae650bb86ba5', 'a55ef1fb-833a-4dbc-a53b-58053c7a9e2d', '753caabd-b31c-45ed-9351-b444af1e1431'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:15 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:14:15 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:15 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.319s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:14:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Deleted volume successfully. Sep 01 01:14:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e9a639ef-2dd2-41bf-afd9-5a0126373135 tempest-VolumesMetadataTest-1101204742 None] Lock "cinder-cd16be29-935f-4fc3-8498-43742374d0de-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:25 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=76,cinder:INSERT=25,cinder:UPDATE=105,cinder:DELETE=8 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:14:25 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=54,cinder:INSERT=24,cinder:UPDATE=93,cinder:DELETE=8 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (2bc4f40f-0d0d-431a-a019-40eeba2734fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d31fa9d-24f6-492a-8661-876bc5eed29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d31fa9d-24f6-492a-8661-876bc5eed29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1389776990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59f44bc-3f7e-4434-bf71-c530fd46601b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:27Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85160f1e-b45c-4915-be76-379234148b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85160f1e-b45c-4915-be76-379234148b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99795218-7430-43fe-8722-afde8a3d3eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99795218-7430-43fe-8722-afde8a3d3eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59f44bc-3f7e-4434-bf71-c530fd46601b', 'volume_name': 'volume-c59f44bc-3f7e-4434-bf71-c530fd46601b', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984f5d8f-e449-41ab-baf4-9ae27f185bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984f5d8f-e449-41ab-baf4-9ae27f185bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b92d59e-9586-4eef-911a-8e191c503c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:26 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Volume c59f44bc-3f7e-4434-bf71-c530fd46601b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59f44bc-3f7e-4434-bf71-c530fd46601b', 'volume_size': 1} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1389776990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59f44bc-3f7e-4434-bf71-c530fd46601b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:27Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Creating volume c59f44bc-3f7e-4434-bf71-c530fd46601b {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:14:26 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:26 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b 1073741824 Sep 01 01:14:26 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Flow 'volume_create_manager' (7485deed-c9a0-480b-837c-696809ab0bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf411f4-d1e7-48fd-a951-f8d224d42ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf411f4-d1e7-48fd-a951-f8d224d42ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1312271146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d1136c-5829-4118-8870-37955ea38684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92044937972b4ee2adccb9a3dd6d6404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:27Z,use_quota=True,user_id='7812cf8013ac45fdae8e6edf59549458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3ff2fc-cd30-4cbe-be43-e4867e494198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3ff2fc-cd30-4cbe-be43-e4867e494198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765115e9-866b-4325-8ee6-549e9c88836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765115e9-866b-4325-8ee6-549e9c88836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d1136c-5829-4118-8870-37955ea38684', 'volume_name': 'volume-50d1136c-5829-4118-8870-37955ea38684', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23feecb-ba38-4dc8-ba1a-8bbd93671dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23feecb-ba38-4dc8-ba1a-8bbd93671dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7847448-a31d-49a1-ac9b-27b489e22fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:26 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Volume 50d1136c-5829-4118-8870-37955ea38684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d1136c-5829-4118-8870-37955ea38684', 'volume_size': 1} Sep 01 01:14:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:27 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b 1073741824" returned: 0 in 0.534s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:27 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b Sep 01 01:14:27 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:27 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b" returned: 0 in 0.332s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1312271146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d1136c-5829-4118-8870-37955ea38684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92044937972b4ee2adccb9a3dd6d6404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:27Z,use_quota=True,user_id='7812cf8013ac45fdae8e6edf59549458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Creating volume 50d1136c-5829-4118-8870-37955ea38684 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:14:27 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b92d59e-9586-4eef-911a-8e191c503c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59f44bc-3f7e-4434-bf71-c530fd46601b', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:27 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684 1073741824 Sep 01 01:14:27 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8baa907e-1d1d-4bfe-a136-f4ec5c1b31a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:27 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Volume volume-c59f44bc-3f7e-4434-bf71-c530fd46601b (c59f44bc-3f7e-4434-bf71-c530fd46601b): created successfully Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8baa907e-1d1d-4bfe-a136-f4ec5c1b31a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (2bc4f40f-0d0d-431a-a019-40eeba2734fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:27 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a15dbac3-f097-4a42-ab84-7f5cf6092075 tempest-VolumesGetTest-1952230569 None] Created volume successfully. Sep 01 01:14:28 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684 1073741824" returned: 0 in 0.624s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:28 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684 Sep 01 01:14:28 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:28 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684" returned: 0 in 0.408s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:14:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7847448-a31d-49a1-ac9b-27b489e22fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d1136c-5829-4118-8870-37955ea38684', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9800f60c-474d-4fd6-bad4-a466e1fbf8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:28 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Volume volume-50d1136c-5829-4118-8870-37955ea38684 (50d1136c-5829-4118-8870-37955ea38684): created successfully Sep 01 01:14:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9800f60c-474d-4fd6-bad4-a466e1fbf8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Flow 'volume_create_manager' (7485deed-c9a0-480b-837c-696809ab0bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:29 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e3dcf306-70f2-42b5-b275-63e616ccfb49 tempest-VolumesTransfersTest-214304112 None] Created volume successfully. Sep 01 01:14:29 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-f9c5fb80-1bbd-4d4e-a06a-7e4a1a253583 req-34d11d84-559f-45b5-bc08-ff34606f2b8b tempest-TestShelveInstance-1237028677 None] Terminate volume connection completed successfully. Sep 01 01:14:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-f9c5fb80-1bbd-4d4e-a06a-7e4a1a253583 req-34d11d84-559f-45b5-bc08-ff34606f2b8b tempest-TestShelveInstance-1237028677 None] Deleting attachment 1da774d6-2295-41a0-bbf3-f81d90207ead. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:14:29 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (45446efe-f6f2-4cec-97d3-4fac5a0e5e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6883d5a8-fbd7-42e0-9e2f-85c0966f515b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6883d5a8-fbd7-42e0-9e2f-85c0966f515b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2055497710',display_name='tempest-VolumesGetTest-Volume-1163539749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e58bce-02a0-40b5-9f88-9fdebef43123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:30Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb83a58-ba2f-4736-9325-6092d7496b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb83a58-ba2f-4736-9325-6092d7496b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687da1b7-d629-4df5-8fae-e17125c80fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687da1b7-d629-4df5-8fae-e17125c80fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e58bce-02a0-40b5-9f88-9fdebef43123', 'volume_name': 'volume-86e58bce-02a0-40b5-9f88-9fdebef43123', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e049c3-7a49-4261-b41e-df04409fa0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e049c3-7a49-4261-b41e-df04409fa0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da23435-71c1-433c-9ee9-5f2079fd1706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Volume 86e58bce-02a0-40b5-9f88-9fdebef43123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e58bce-02a0-40b5-9f88-9fdebef43123', 'volume_size': 1} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2055497710',display_name='tempest-VolumesGetTest-Volume-1163539749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e58bce-02a0-40b5-9f88-9fdebef43123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:30Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Creating volume 86e58bce-02a0-40b5-9f88-9fdebef43123 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:14:30 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:30 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123 1073741824 Sep 01 01:14:30 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:30 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123 1073741824" returned: 0 in 0.840s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:31 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123 Sep 01 01:14:31 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:31 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c4d6296d-702a-44e9-abda-8f1a35f5ac29 tempest-VolumesTransfersTest-778441448 None] Transfer volume completed successfully. Sep 01 01:14:31 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123" returned: 0 in 0.420s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:14:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da23435-71c1-433c-9ee9-5f2079fd1706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e58bce-02a0-40b5-9f88-9fdebef43123', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb985a0c-9407-4e6f-9b97-acc2c705b41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:31 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Volume volume-86e58bce-02a0-40b5-9f88-9fdebef43123 (86e58bce-02a0-40b5-9f88-9fdebef43123): created successfully Sep 01 01:14:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb985a0c-9407-4e6f-9b97-acc2c705b41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (45446efe-f6f2-4cec-97d3-4fac5a0e5e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:31 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-99fb50f3-10b7-478f-bda2-d13c9182f946 tempest-VolumesGetTest-1952230569 None] Created volume successfully. Sep 01 01:14:31 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Acquiring lock "cinder-50d1136c-5829-4118-8870-37955ea38684-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:31 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Lock "cinder-50d1136c-5829-4118-8870-37955ea38684-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Acquiring lock "cinder-quobyte-50d1136c-5829-4118-8870-37955ea38684" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Lock "cinder-quobyte-50d1136c-5829-4118-8870-37955ea38684" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2313fd8-7412-4439-bada-fe1cf0acd58a]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:32 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684 Sep 01 01:14:32 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-86e58bce-02a0-40b5-9f88-9fdebef43123-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Lock "cinder-86e58bce-02a0-40b5-9f88-9fdebef43123-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-quobyte-86e58bce-02a0-40b5-9f88-9fdebef43123" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-86e58bce-02a0-40b5-9f88-9fdebef43123" acquired by "delete_volume" :: waited 0.044s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f98e861-2f4b-493c-86ce-2bd78e2c292c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:32 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684" returned: 0 in 0.813s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:32 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684 Sep 01 01:14:32 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:33 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123 Sep 01 01:14:33 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:33 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-50d1136c-5829-4118-8870-37955ea38684" returned: 0 in 0.364s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Lock "cinder-quobyte-50d1136c-5829-4118-8870-37955ea38684" released by "delete_volume" :: held 1.249s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:33 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Created reservations ['d930f169-da6c-4195-a402-c168b76d8c2c', '5ae17859-7a87-4e53-a516-faaea82991a6', '32a8ebe6-825e-44cc-bb3e-9cae1fc06a87', '9434b79f-385b-449b-a21a-e3b0a9eba3a9'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:14:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:33 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:14:33 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:33 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123" returned: 0 in 0.873s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:33 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123 Sep 01 01:14:33 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:34 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:34 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.468s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-86e58bce-02a0-40b5-9f88-9fdebef43123" returned: 0 in 0.430s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-e06bcecc-af9e-4f55-ae81-9516dd6cec37 req-2d19248e-6439-42c4-89a7-cc0beb6d610e tempest-TestShelveInstance-1237028677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-e06bcecc-af9e-4f55-ae81-9516dd6cec37 req-2d19248e-6439-42c4-89a7-cc0beb6d610e tempest-TestShelveInstance-1237028677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Deleted volume successfully. Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-86e58bce-02a0-40b5-9f88-9fdebef43123" released by "delete_volume" :: held 1.435s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-e06bcecc-af9e-4f55-ae81-9516dd6cec37 req-2d19248e-6439-42c4-89a7-cc0beb6d610e tempest-TestShelveInstance-1237028677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.057s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a22705eb-373c-45b9-8071-05e72d829c6d tempest-VolumesTransfersTest-774162278 None] Lock "cinder-50d1136c-5829-4118-8870-37955ea38684-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-e06bcecc-af9e-4f55-ae81-9516dd6cec37 req-2d19248e-6439-42c4-89a7-cc0beb6d610e tempest-TestShelveInstance-1237028677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c245ce50-ea51-40cf-a637-3bd1323adec3', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Created reservations ['a055b830-2159-4a5d-8b87-b7b1ab504c76', 'c53a7d1b-7bc9-4076-98f6-59a1834ce1fa', '32700667-2aef-43a1-9997-8436fe4d68f3', 'b84edaa9-b722-4c2d-90bd-bbd908410b24'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:14:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-e06bcecc-af9e-4f55-ae81-9516dd6cec37 req-2d19248e-6439-42c4-89a7-cc0beb6d610e tempest-TestShelveInstance-1237028677 None] attachment_update completed successfully. Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:34 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:14:34 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:34 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.373s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:14:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Deleted volume successfully. Sep 01 01:14:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e7f618cc-00b0-44eb-8863-7fe143d88c46 tempest-VolumesGetTest-1952230569 None] Lock "cinder-86e58bce-02a0-40b5-9f88-9fdebef43123-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-c59f44bc-3f7e-4434-bf71-c530fd46601b-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Lock "cinder-c59f44bc-3f7e-4434-bf71-c530fd46601b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-quobyte-c59f44bc-3f7e-4434-bf71-c530fd46601b" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-c59f44bc-3f7e-4434-bf71-c530fd46601b" acquired by "delete_volume" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec313a3c-90a5-4c63-828a-cb8bfc88c32f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Flow 'volume_create_manager' (9666a7e6-7565-49bc-8fee-15160ca51334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02f7474-42af-4a50-bffa-dcc4ec2079ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02f7474-42af-4a50-bffa-dcc4ec2079ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-449099501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0920d306-405e-4c1e-9087-5c3805cc195a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92044937972b4ee2adccb9a3dd6d6404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:35Z,use_quota=True,user_id='7812cf8013ac45fdae8e6edf59549458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1452d9e8-42aa-488b-8f17-a4047f138d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1452d9e8-42aa-488b-8f17-a4047f138d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e214aa-dd38-4501-987d-369bd4f3d643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e214aa-dd38-4501-987d-369bd4f3d643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0920d306-405e-4c1e-9087-5c3805cc195a', 'volume_name': 'volume-0920d306-405e-4c1e-9087-5c3805cc195a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:35 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b Sep 01 01:14:35 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e50c32-92bf-4e8b-b123-b3eb368654d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e50c32-92bf-4e8b-b123-b3eb368654d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a0487a-0389-4920-8d17-9fc0732327c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:35 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Volume 0920d306-405e-4c1e-9087-5c3805cc195a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0920d306-405e-4c1e-9087-5c3805cc195a', 'volume_size': 1} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-449099501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0920d306-405e-4c1e-9087-5c3805cc195a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92044937972b4ee2adccb9a3dd6d6404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:35Z,use_quota=True,user_id='7812cf8013ac45fdae8e6edf59549458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Creating volume 0920d306-405e-4c1e-9087-5c3805cc195a {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:14:35 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:35 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a 1073741824 Sep 01 01:14:35 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:35 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b" returned: 0 in 0.516s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:35 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b Sep 01 01:14:35 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:36 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c59f44bc-3f7e-4434-bf71-c530fd46601b" returned: 0 in 0.423s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:36 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-c59f44bc-3f7e-4434-bf71-c530fd46601b" released by "delete_volume" :: held 1.058s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a 1073741824" returned: 0 in 0.746s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:36 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a Sep 01 01:14:36 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Created reservations ['9eeda3fe-8b05-429c-83f0-9f014c032f1e', 'c23166f8-b815-4653-bfed-9d29f06231b4', '63e7cff9-38d2-461f-a0f0-abce644cb4cf', 'bd14986d-025b-4d47-b6ec-d3c716c2076a'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:36 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:14:36 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:36 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a" returned: 0 in 0.529s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a0487a-0389-4920-8d17-9fc0732327c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0920d306-405e-4c1e-9087-5c3805cc195a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1312109d-9740-4723-9056-597e50bc8b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:37 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Volume volume-0920d306-405e-4c1e-9087-5c3805cc195a (0920d306-405e-4c1e-9087-5c3805cc195a): created successfully Sep 01 01:14:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1312109d-9740-4723-9056-597e50bc8b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Flow 'volume_create_manager' (9666a7e6-7565-49bc-8fee-15160ca51334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:37 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-221a2246-87c6-4bb3-9642-4721697d27f5 tempest-VolumesTransfersTest-214304112 None] Created volume successfully. Sep 01 01:14:37 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.474s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:37 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:14:37 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Deleted volume successfully. Sep 01 01:14:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-36355ab6-0130-4eb9-9658-7d7dbfc38e8d tempest-VolumesGetTest-1952230569 None] Lock "cinder-c59f44bc-3f7e-4434-bf71-c530fd46601b-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Flow 'volume_create_manager' (9bbc32e3-d375-4f33-9dc1-e4efdfd739a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8df384-82e5-4c4b-9123-264750bd03b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8df384-82e5-4c4b-9123-264750bd03b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1059703399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf2e284-e880-44b2-be68-74c897e9c35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e27e5e9c04f3bab30ce8096f8d55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:38Z,use_quota=True,user_id='323ed9b6c82545dc8d47b221600ec4fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0efdea-fe11-49d7-a07a-802cfe1031ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0efdea-fe11-49d7-a07a-802cfe1031ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31f0a0c-50d4-4b22-b4e4-2a7fc6f3ed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31f0a0c-50d4-4b22-b4e4-2a7fc6f3ed78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cf2e284-e880-44b2-be68-74c897e9c35d', 'volume_name': 'volume-7cf2e284-e880-44b2-be68-74c897e9c35d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2edfd1-64a0-4289-9326-a9fdc7ced000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2edfd1-64a0-4289-9326-a9fdc7ced000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc31506f-f7e5-4bd8-8258-14205ff6d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:38 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Volume 7cf2e284-e880-44b2-be68-74c897e9c35d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cf2e284-e880-44b2-be68-74c897e9c35d', 'volume_size': 1} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1059703399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf2e284-e880-44b2-be68-74c897e9c35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e27e5e9c04f3bab30ce8096f8d55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:38Z,use_quota=True,user_id='323ed9b6c82545dc8d47b221600ec4fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Creating volume 7cf2e284-e880-44b2-be68-74c897e9c35d {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:14:38 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Acquiring lock "cinder-0920d306-405e-4c1e-9087-5c3805cc195a-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:38 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d 1073741824 Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Lock "cinder-0920d306-405e-4c1e-9087-5c3805cc195a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:38 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Acquiring lock "cinder-quobyte-0920d306-405e-4c1e-9087-5c3805cc195a" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Lock "cinder-quobyte-0920d306-405e-4c1e-9087-5c3805cc195a" acquired by "delete_volume" :: waited 0.032s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c651f3e-fd12-40d8-b38b-36597f92daca]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (20fbbfed-3a2a-4e4f-a130-db563667553e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b74098-a4b1-4d3a-995c-9b06aa552d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b74098-a4b1-4d3a-995c-9b06aa552d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1410268388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13781af3-942d-45c1-b1eb-baae4c2ff563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:39Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba961960-5f6c-482d-ac35-81a93fd65f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba961960-5f6c-482d-ac35-81a93fd65f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928c59ec-bac0-4d76-84f2-7e85370ba8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928c59ec-bac0-4d76-84f2-7e85370ba8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13781af3-942d-45c1-b1eb-baae4c2ff563', 'volume_name': 'volume-13781af3-942d-45c1-b1eb-baae4c2ff563', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a90c18-779f-45e3-91a7-0e16e4610b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a90c18-779f-45e3-91a7-0e16e4610b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:38 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a Sep 01 01:14:38 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabb159a-52b3-4721-ac85-7ff1f18f9575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:38 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Volume 13781af3-942d-45c1-b1eb-baae4c2ff563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13781af3-942d-45c1-b1eb-baae4c2ff563', 'volume_size': 1} Sep 01 01:14:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:39 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d 1073741824" returned: 0 in 0.905s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:39 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:39 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a" returned: 0 in 0.773s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:39 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:39 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a Sep 01 01:14:39 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:39 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d" returned: 0 in 0.405s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1410268388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13781af3-942d-45c1-b1eb-baae4c2ff563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:39Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Creating volume 13781af3-942d-45c1-b1eb-baae4c2ff563 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:14:39 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:39 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc31506f-f7e5-4bd8-8258-14205ff6d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cf2e284-e880-44b2-be68-74c897e9c35d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:39 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 1073741824 Sep 01 01:14:39 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34651b28-a307-4105-a4b9-0232cc0e8111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0920d306-405e-4c1e-9087-5c3805cc195a" returned: 0 in 0.448s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Lock "cinder-quobyte-0920d306-405e-4c1e-9087-5c3805cc195a" released by "delete_volume" :: held 1.304s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Volume volume-7cf2e284-e880-44b2-be68-74c897e9c35d (7cf2e284-e880-44b2-be68-74c897e9c35d): created successfully Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34651b28-a307-4105-a4b9-0232cc0e8111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Flow 'volume_create_manager' (9bbc32e3-d375-4f33-9dc1-e4efdfd739a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:39 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-bcff3b62-bdee-4490-b83c-fb1ad94a301a tempest-TestImageHashVerification-1135397039 None] Created volume successfully. Sep 01 01:14:39 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Created reservations ['2ed713e4-af42-48bd-9427-72196b724da3', '21c42452-812e-4a6b-aae0-98c59a3a526c', 'd3ac6668-6074-4212-ba51-3da214df9d9c', '881794e0-48e1-4535-a9b3-8bb989ebb356'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:14:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:40 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:14:40 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:40 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.585s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:40 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:14:40 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Deleted volume successfully. Sep 01 01:14:40 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 1073741824" returned: 0 in 0.983s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-360dc588-a338-4aba-b299-290dda54cbbc tempest-VolumesTransfersTest-774162278 None] Lock "cinder-0920d306-405e-4c1e-9087-5c3805cc195a-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:14:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:40 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 Sep 01 01:14:40 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:41 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563" returned: 0 in 0.337s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:14:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabb159a-52b3-4721-ac85-7ff1f18f9575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13781af3-942d-45c1-b1eb-baae4c2ff563', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ca3be6-8833-4ec1-9573-f83be5f77d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:41 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Volume volume-13781af3-942d-45c1-b1eb-baae4c2ff563 (13781af3-942d-45c1-b1eb-baae4c2ff563): created successfully Sep 01 01:14:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ca3be6-8833-4ec1-9573-f83be5f77d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (20fbbfed-3a2a-4e4f-a130-db563667553e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:41 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8e4652a0-2430-4d08-953c-88647eecccd1 tempest-VolumesGetTest-1952230569 None] Created volume successfully. Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (aeb68c6b-28ec-43ff-9968-d5156603779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0766a877-f65d-40fe-a83a-051fde057896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0766a877-f65d-40fe-a83a-051fde057896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-772572414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f139b62-2f6b-4a52-87cb-8427ab757178,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=13781af3-942d-45c1-b1eb-baae4c2ff563,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:43Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d5f0c27-1056-4343-b2da-209eb122f612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d5f0c27-1056-4343-b2da-209eb122f612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82dace9d-496c-4f58-a19b-6335d9f32829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82dace9d-496c-4f58-a19b-6335d9f32829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5f139b62-2f6b-4a52-87cb-8427ab757178', 'volume_name': 'volume-5f139b62-2f6b-4a52-87cb-8427ab757178', 'volume_size': 1, 'source_volid': '13781af3-942d-45c1-b1eb-baae4c2ff563', 'source_volstatus': 'available'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51800136-7858-42a3-8f61-e066d23d55e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51800136-7858-42a3-8f61-e066d23d55e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d45cd2-f6da-45a7-ac60-a1a9228bb533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:43 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Volume 5f139b62-2f6b-4a52-87cb-8427ab757178: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5f139b62-2f6b-4a52-87cb-8427ab757178', 'volume_size': 1, 'source_volid': '13781af3-942d-45c1-b1eb-baae4c2ff563', 'source_volstatus': 'available'} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fd3fa1-256a-4a88-8239-6525e064877c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:14:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:43 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d Sep 01 01:14:43 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:44 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d" returned: 0 in 0.605s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:44 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a342d52-8d97-4a1c-8e43-de8807deb65f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:14:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:44 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d Sep 01 01:14:44 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:44 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d" returned: 0 in 0.642s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d /opt/stack/data/cinder/conversion/7cf2e284-e880-44b2-be68-74c897e9c35d.temp_image.d95548f5-f305-4013-ac73-f3e0feeb02cd8qcmhtye.img {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:44 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d /opt/stack/data/cinder/conversion/7cf2e284-e880-44b2-be68-74c897e9c35d.temp_image.d95548f5-f305-4013-ac73-f3e0feeb02cd8qcmhtye.img Sep 01 01:14:44 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:52 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d /opt/stack/data/cinder/conversion/7cf2e284-e880-44b2-be68-74c897e9c35d.temp_image.d95548f5-f305-4013-ac73-f3e0feeb02cd8qcmhtye.img" returned: 0 in 7.200s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[024028b7-8df5-48d6-a93c-9cbe75397693]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:52 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d Sep 01 01:14:52 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:14:52 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:14:52 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:14:52 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d" returned: 0 in 0.698s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d, size 1024.00 MB, duration 7.20 sec, destination /opt/stack/data/cinder/conversion/7cf2e284-e880-44b2-be68-74c897e9c35d.temp_image.d95548f5-f305-4013-ac73-f3e0feeb02cd8qcmhtye.img {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:14:52 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] Converted 1024.00 MB image at 142.20 MB/s Sep 01 01:14:52 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] d95548f5-f305-4013-ac73-f3e0feeb02cd was raw, no need to convert to raw {{(pid=87064) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 01:14:53 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Sep 01 01:14:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.440s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:14:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:14:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:14:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:14:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:14:53 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=46,cinder:UPDATE=47,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Flow 'volume_create_manager' (2d103c1e-29bf-4fc9-9104-56c91c69f669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0113025-f231-40d6-a419-33b0380e1e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0113025-f231-40d6-a419-33b0380e1e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1157639050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9f6db2-2ab2-4706-b0b6-175beff8aa61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd0c5242b484c57a767529a35f488b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:54Z,use_quota=True,user_id='133fd87efa7d430cb55f76a585154aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f91d03a-615b-47d0-8f60-1232bd973e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f91d03a-615b-47d0-8f60-1232bd973e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bb1898-7946-496a-8040-34bd86f5d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bb1898-7946-496a-8040-34bd86f5d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9f6db2-2ab2-4706-b0b6-175beff8aa61', 'volume_name': 'volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273d5bc8-b798-4725-951d-d2a28771e02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273d5bc8-b798-4725-951d-d2a28771e02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d587b9e1-98b6-4c29-bbbf-2c0fce484b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:14:54 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Volume 0b9f6db2-2ab2-4706-b0b6-175beff8aa61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61', 'volume_size': 1} Sep 01 01:14:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:04 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:15:04 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=57,cinder:SELECT=42,cinder:DELETE=7,cinder:INSERT=11 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:15:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.435s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] Uploaded volume to glance image-id: d95548f5-f305-4013-ac73-f3e0feeb02cd. {{(pid=87064) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 01:15:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 31.403s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:15 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Cloning volume 13781af3-942d-45c1-b1eb-baae4c2ff563 to volume 5f139b62-2f6b-4a52-87cb-8427ab757178 Sep 01 01:15:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9c02c56c-9872-49cc-b377-387fe03c0997 tempest-TestImageHashVerification-1135397039 None] Copy volume to image completed successfully. Sep 01 01:15:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Creating offline snapshot 76f70b90-6d68-4f4b-a9e9-0465fff05807 of volume 13781af3-942d-45c1-b1eb-baae4c2ff563 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:15:15 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67df7e-1b18-4f74-9676-d6075e329fc4]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:15 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 Sep 01 01:15:15 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:15 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563" returned: 0 in 0.444s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:15 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 1G Sep 01 01:15:15 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Acquiring lock "cinder-7cf2e284-e880-44b2-be68-74c897e9c35d-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Lock "cinder-7cf2e284-e880-44b2-be68-74c897e9c35d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Acquiring lock "cinder-quobyte-7cf2e284-e880-44b2-be68-74c897e9c35d" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Lock "cinder-quobyte-7cf2e284-e880-44b2-be68-74c897e9c35d" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:16 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 1G" returned: 0 in 0.508s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13781af3-942d-45c1-b1eb-baae4c2ff563 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bced3add-0a3f-4a1c-b5bd-043de36521d9]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:16 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13781af3-942d-45c1-b1eb-baae4c2ff563 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 Sep 01 01:15:16 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:16 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d Sep 01 01:15:16 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:16 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13781af3-942d-45c1-b1eb-baae4c2ff563 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807" returned: 0 in 0.319s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:16 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 is being set with open permissions: ugo+rw Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:16 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 Sep 01 01:15:16 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:16 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d" returned: 0 in 0.468s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:16 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d Sep 01 01:15:16 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:16 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807" returned: 0 in 0.263s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:16 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.info Sep 01 01:15:16 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:16 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7cf2e284-e880-44b2-be68-74c897e9c35d" returned: 0 in 0.288s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Lock "cinder-quobyte-7cf2e284-e880-44b2-be68-74c897e9c35d" released by "delete_volume" :: held 0.806s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Created reservations ['6f448f88-1937-407d-b0d1-2c765bd5ecf3', 'bd532ced-49e1-453d-8c9b-74f70a951cf8', '11fe5051-0336-46d0-beb9-18d6e9f63c53', '4f4c8b14-86ea-4cad-9578-e37d082cdc74'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:15:16 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.info" returned: 0 in 0.301s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:16 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.info is being set with open permissions: ugo+rw Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:17 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.info Sep 01 01:15:17 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:17 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:15:17 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:17 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.info" returned: 0 in 0.321s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:17 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-quobyte-5f139b62-2f6b-4a52-87cb-8427ab757178" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.326s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:15:17 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Deleted volume successfully. Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-5f139b62-2f6b-4a52-87cb-8427ab757178" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] snapshot: 76f70b90-6d68-4f4b-a9e9-0465fff05807, volume: 5f139b62-2f6b-4a52-87cb-8427ab757178, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0334fc1-c967-43eb-9751-2095303e046d]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a6ccd884-7989-434d-a6df-0c8f8966ae4d tempest-TestImageHashVerification-1135397039 None] Lock "cinder-7cf2e284-e880-44b2-be68-74c897e9c35d-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:17 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 Sep 01 01:15:17 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:17 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807" returned: 0 in 0.444s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13781af3-942d-45c1-b1eb-baae4c2ff563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3730e3-5e3b-4b22-b7c5-eb3a82b39428]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:17 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 Sep 01 01:15:17 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:18 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563" returned: 0 in 0.484s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:15:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:15:18 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178 not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:15:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:18 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178 Sep 01 01:15:18 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:23 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178" returned: 0 in 5.194s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:23 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:15:23 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Converted 1024.00 MB image at 196.97 MB/s Sep 01 01:15:23 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178 is being set with open permissions: ugo+rw Sep 01 01:15:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:23 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178 Sep 01 01:15:23 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:23 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178" returned: 0 in 0.369s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-5f139b62-2f6b-4a52-87cb-8427ab757178" released by "_copy_volume_from_snapshot" :: held 6.595s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-quobyte-76f70b90-6d68-4f4b-a9e9-0465fff05807" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-76f70b90-6d68-4f4b-a9e9-0465fff05807" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Deleting offline snapshot 76f70b90-6d68-4f4b-a9e9-0465fff05807 of volume 13781af3-942d-45c1-b1eb-baae4c2ff563 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:15:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] snapshot_file for this snap is: volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:15:24 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6daf47-d6a6-4b7d-9ae0-14f1edba07cf]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:24 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 Sep 01 01:15:24 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:24 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807" returned: 0 in 0.508s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13781af3-942d-45c1-b1eb-baae4c2ff563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:15:24 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa1061e-c750-4d86-a545-01da92578fb4]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:24 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 Sep 01 01:15:24 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:25 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563" returned: 0 in 1.004s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:25 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 Sep 01 01:15:25 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:26 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807" returned: 0 in 0.462s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:26 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807 Sep 01 01:15:26 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:26 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563.76f70b90-6d68-4f4b-a9e9-0465fff05807" returned: 0 in 0.286s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-76f70b90-6d68-4f4b-a9e9-0465fff05807" released by "_delete_snapshot" :: held 2.488s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.528s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.032s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1157639050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9f6db2-2ab2-4706-b0b6-175beff8aa61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd0c5242b484c57a767529a35f488b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:14:54Z,use_quota=True,user_id='133fd87efa7d430cb55f76a585154aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Creating volume 0b9f6db2-2ab2-4706-b0b6-175beff8aa61 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:15:26 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:26 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 1073741824 Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d45cd2-f6da-45a7-ac60-a1a9228bb533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f139b62-2f6b-4a52-87cb-8427ab757178', 'volume_size': 1, 'source_volid': '13781af3-942d-45c1-b1eb-baae4c2ff563', 'source_volstatus': 'available'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:26 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3166ba6-8a1a-4b53-938f-ca1d4f276af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:26 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Volume volume-5f139b62-2f6b-4a52-87cb-8427ab757178 (5f139b62-2f6b-4a52-87cb-8427ab757178): created successfully Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3166ba6-8a1a-4b53-938f-ca1d4f276af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (aeb68c6b-28ec-43ff-9968-d5156603779f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:26 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5770e329-0cb4-4eb7-892f-c84d7028bca0 tempest-VolumesGetTest-1952230569 None] Created volume successfully. Sep 01 01:15:27 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-aec72199-8ca9-4263-9837-6a0d75fd88ae tempest-TestShelveInstance-1237028677 None] Terminate volume connection completed successfully. Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-aec72199-8ca9-4263-9837-6a0d75fd88ae tempest-TestShelveInstance-1237028677 None] Deleting attachment c245ce50-ea51-40cf-a637-3bd1323adec3. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:15:27 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 1073741824" returned: 0 in 0.773s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:27 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 Sep 01 01:15:27 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Acquiring lock "cinder-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Lock "cinder-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Acquiring lock "cinder-quobyte-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Lock "cinder-quobyte-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[744dc926-2151-47ed-a2e8-c081408b7ff6]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:27 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c Sep 01 01:15:27 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:27 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61" returned: 0 in 0.482s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d587b9e1-98b6-4c29-bbbf-2c0fce484b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002ad77b-626b-417b-932f-ba8887ef921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:27 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Volume volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 (0b9f6db2-2ab2-4706-b0b6-175beff8aa61): created successfully Sep 01 01:15:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002ad77b-626b-417b-932f-ba8887ef921a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Flow 'volume_create_manager' (2d103c1e-29bf-4fc9-9104-56c91c69f669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:28 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2758ecfa-ef40-4519-90c7-3e3f784c1035 tempest-VolumesCloneTest-1086301818 None] Created volume successfully. Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (6eab32cf-9cfd-44a5-bb90-6ec7b96fc08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e737e1-c264-4d08-89ca-3842038507a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:28 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c" returned: 0 in 0.790s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:28 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e737e1-c264-4d08-89ca-3842038507a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-357299857',display_name='tempest-VolumesGetTest-Volume-165805967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccbbaa6-cf10-4f90-a736-4de2817e8426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:28Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:28 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c3c52e-7454-4119-adbd-de695138b5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c3c52e-7454-4119-adbd-de695138b5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d45c609-0a6b-4842-b1a1-898f764bd3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d45c609-0a6b-4842-b1a1-898f764bd3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ccbbaa6-cf10-4f90-a736-4de2817e8426', 'volume_name': 'volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36642ade-6feb-44de-8482-3e645e561eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36642ade-6feb-44de-8482-3e645e561eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c09a55-9f9b-4c5b-b005-31115c4ba2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:28 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Volume 2ccbbaa6-cf10-4f90-a736-4de2817e8426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426', 'volume_size': 1} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-357299857',display_name='tempest-VolumesGetTest-Volume-165805967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccbbaa6-cf10-4f90-a736-4de2817e8426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:28Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Creating volume 2ccbbaa6-cf10-4f90-a736-4de2817e8426 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:15:28 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:28 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426 1073741824 Sep 01 01:15:28 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:28 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c" returned: 0 in 0.458s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Lock "cinder-quobyte-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c" released by "delete_volume" :: held 1.327s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.quota [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Created reservations ['a0470165-1ed6-46c4-b815-57a543d7be98', '98d6682f-09fd-4f28-8524-80b7df0fca5f', '0c74cee2-f960-40fe-9928-dfee586f2e3f', '1194c6d0-4a54-4302-9c70-220767b83182'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:29 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:15:29 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:29 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426 1073741824" returned: 0 in 0.775s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:29 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426 Sep 01 01:15:29 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:29 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.512s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.manager [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:15:29 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Deleted volume successfully. Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [req-a26b67a6-5d4b-4812-bccf-30faace06c1b req-383b36df-ef80-4a8e-97e3-5da8358ef9be tempest-TestShelveInstance-1237028677 None] Lock "cinder-7efd4fc5-ea88-44fe-a8e7-b00efb2ed07c-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Flow 'volume_create_manager' (e6baa73c-b7f5-43ed-8ed0-432476e73128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3bf171-019b-4399-ab0f-4b889420cd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3bf171-019b-4399-ab0f-4b889420cd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1589978103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63097c8-862b-4df9-85c6-3ab6bf554556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd0c5242b484c57a767529a35f488b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=0b9f6db2-2ab2-4706-b0b6-175beff8aa61,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:30Z,use_quota=True,user_id='133fd87efa7d430cb55f76a585154aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:29 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e81cd9-e644-41eb-9118-5229e46969f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e81cd9-e644-41eb-9118-5229e46969f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bd26f4-aa8a-4d8e-b186-c2a83507e4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426" returned: 0 in 0.470s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bd26f4-aa8a-4d8e-b186-c2a83507e4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e63097c8-862b-4df9-85c6-3ab6bf554556', 'volume_name': 'volume-e63097c8-862b-4df9-85c6-3ab6bf554556', 'volume_size': 2, 'source_volid': '0b9f6db2-2ab2-4706-b0b6-175beff8aa61', 'source_volstatus': 'available'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e5058a-8ad7-4be6-8840-e39524d47066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e5058a-8ad7-4be6-8840-e39524d47066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8a905d-111c-4cdb-9adf-9e3933e37f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:29 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Volume e63097c8-862b-4df9-85c6-3ab6bf554556: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e63097c8-862b-4df9-85c6-3ab6bf554556', 'volume_size': 2, 'source_volid': '0b9f6db2-2ab2-4706-b0b6-175beff8aa61', 'source_volstatus': 'available'} Sep 01 01:15:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:30 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Cloning volume 0b9f6db2-2ab2-4706-b0b6-175beff8aa61 to volume e63097c8-862b-4df9-85c6-3ab6bf554556 Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c09a55-9f9b-4c5b-b005-31115c4ba2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613af4ef-88cc-4b6f-adba-60fb3280e3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Volume volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426 (2ccbbaa6-cf10-4f90-a736-4de2817e8426): created successfully Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613af4ef-88cc-4b6f-adba-60fb3280e3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (6eab32cf-9cfd-44a5-bb90-6ec7b96fc08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Creating offline snapshot 472f3012-bbc3-4774-b7aa-aa135a186b45 of volume 0b9f6db2-2ab2-4706-b0b6-175beff8aa61 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:15:30 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-fd35eb74-0b60-4b47-b037-b37ec69f037d tempest-VolumesGetTest-1952230569 None] Created volume successfully. Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce775d0-311a-4a31-b539-111148915906]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:30 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 Sep 01 01:15:30 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:30 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61" returned: 0 in 0.602s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:30 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 1G Sep 01 01:15:30 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-2ccbbaa6-cf10-4f90-a736-4de2817e8426-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Lock "cinder-2ccbbaa6-cf10-4f90-a736-4de2817e8426-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-quobyte-2ccbbaa6-cf10-4f90-a736-4de2817e8426" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:30 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-2ccbbaa6-cf10-4f90-a736-4de2817e8426" acquired by "delete_volume" :: waited 0.039s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:31 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec2bb6a-3957-48a6-8c6c-0786a3491711]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:31 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426 Sep 01 01:15:31 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:31 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 1G" returned: 0 in 0.630s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:31 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 Sep 01 01:15:31 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:31 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426" returned: 0 in 0.455s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:31 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426 Sep 01 01:15:31 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:31 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45" returned: 0 in 0.568s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:31 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 is being set with open permissions: ugo+rw Sep 01 01:15:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:31 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 Sep 01 01:15:31 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:31 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2ccbbaa6-cf10-4f90-a736-4de2817e8426" returned: 0 in 0.478s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:31 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-2ccbbaa6-cf10-4f90-a736-4de2817e8426" released by "delete_volume" :: held 0.997s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Created reservations ['e7754a12-8405-43fe-a670-4a31cd7e61f7', '5c460a12-d146-4887-9f74-213c890e94c1', 'c44f02f8-fae0-486f-86da-c3014dbdb183', '10dd31b3-a178-4ca9-834d-ec29aa15c2dc'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:32 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:15:32 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:32 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45" returned: 0 in 0.446s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:32 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.info Sep 01 01:15:32 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:32 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.376s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:15:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Deleted volume successfully. Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8a80b785-43ad-4118-83ff-7183d8afb17f tempest-VolumesGetTest-1952230569 None] Lock "cinder-2ccbbaa6-cf10-4f90-a736-4de2817e8426-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:32 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.info" returned: 0 in 0.378s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:32 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.info is being set with open permissions: ugo+rw Sep 01 01:15:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:32 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.info Sep 01 01:15:32 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:33 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.info" returned: 0 in 0.310s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Acquiring lock "cinder-quobyte-e63097c8-862b-4df9-85c6-3ab6bf554556" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Lock "cinder-quobyte-e63097c8-862b-4df9-85c6-3ab6bf554556" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] snapshot: 472f3012-bbc3-4774-b7aa-aa135a186b45, volume: e63097c8-862b-4df9-85c6-3ab6bf554556, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8b860f-9f6e-4304-81d2-3738e32420dd]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-5f139b62-2f6b-4a52-87cb-8427ab757178-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:33 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Lock "cinder-5f139b62-2f6b-4a52-87cb-8427ab757178-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:33 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-quobyte-5f139b62-2f6b-4a52-87cb-8427ab757178" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-5f139b62-2f6b-4a52-87cb-8427ab757178" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa8d200-f3b3-4f1a-b937-b8a4ad3375bb]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:33 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178 Sep 01 01:15:33 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:33 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45" returned: 0 in 0.622s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4af4687-eed1-4a05-ac92-550e0f0c174a]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:33 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 Sep 01 01:15:33 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:33 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178" returned: 0 in 0.549s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:34 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178 Sep 01 01:15:34 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:34 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61" returned: 0 in 0.425s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556 not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:34 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556 Sep 01 01:15:34 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:34 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5f139b62-2f6b-4a52-87cb-8427ab757178" returned: 0 in 0.343s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-5f139b62-2f6b-4a52-87cb-8427ab757178" released by "delete_volume" :: held 0.942s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Created reservations ['ed6a909a-f264-4cbb-aacf-534edc848d65', '656f7468-758d-4876-acf6-28aab7a9d172', 'f3e78339-0458-4021-b3e3-c8ba08fe0a2e', 'dbb8d53d-e232-4822-9161-a3131117d1aa'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:34 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:15:34 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:35 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.333s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:35 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:15:35 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Deleted volume successfully. Sep 01 01:15:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1ddbcd7d-83c2-45f0-b464-267f57b9c643 tempest-VolumesGetTest-1952230569 None] Lock "cinder-5f139b62-2f6b-4a52-87cb-8427ab757178-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-13781af3-942d-45c1-b1eb-baae4c2ff563-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Lock "cinder-13781af3-942d-45c1-b1eb-baae4c2ff563-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-quobyte-13781af3-942d-45c1-b1eb-baae4c2ff563" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-13781af3-942d-45c1-b1eb-baae4c2ff563" acquired by "delete_volume" :: waited 0.059s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:36 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf197ba7-3bd7-4060-866e-f76a90290d9f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:37 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 Sep 01 01:15:37 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:37 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563" returned: 0 in 0.974s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:37 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563 Sep 01 01:15:37 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:38 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-13781af3-942d-45c1-b1eb-baae4c2ff563" returned: 0 in 0.769s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-13781af3-942d-45c1-b1eb-baae4c2ff563" released by "delete_volume" :: held 2.022s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:38 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Created reservations ['fa6ad4c2-a97e-4ab4-9787-03ff739b6098', '33c19368-e036-4e99-8c28-46dc550177c9', 'b9a33fe4-868d-4ab1-aae3-3059e79e3b59', '93ed0b2f-06f5-4300-b701-c79863d2256e'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:15:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:39 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:15:39 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:40 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 1.228s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:40 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:15:40 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Deleted volume successfully. Sep 01 01:15:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-742f73e0-688c-4f9d-a647-bef5087aa187 tempest-VolumesGetTest-1952230569 None] Lock "cinder-13781af3-942d-45c1-b1eb-baae4c2ff563-delete_volume" released by "delete_volume" :: held 4.036s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:41 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556" returned: 0 in 6.813s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:15:41 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Converted 1024.00 MB image at 150.27 MB/s Sep 01 01:15:41 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556 is being set with open permissions: ugo+rw Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:41 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556 Sep 01 01:15:41 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:41 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556" returned: 0 in 0.302s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Lock "cinder-quobyte-e63097c8-862b-4df9-85c6-3ab6bf554556" released by "_copy_volume_from_snapshot" :: held 8.272s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Acquiring lock "cinder-quobyte-472f3012-bbc3-4774-b7aa-aa135a186b45" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Lock "cinder-quobyte-472f3012-bbc3-4774-b7aa-aa135a186b45" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Deleting offline snapshot 472f3012-bbc3-4774-b7aa-aa135a186b45 of volume 0b9f6db2-2ab2-4706-b0b6-175beff8aa61 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] snapshot_file for this snap is: volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa33743-fe7b-41e4-846a-42a74cc8eb1f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:41 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 Sep 01 01:15:41 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (68bfa562-40be-40ae-a5a3-1ca2eac2c137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db2ce63-e3e2-40df-89f9-feb01d693a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db2ce63-e3e2-40df-89f9-feb01d693a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1939227032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279bed83-a236-461d-b9e5-18addeabce34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:42Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cbef80-1b76-486e-a049-1a23eeba526a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cbef80-1b76-486e-a049-1a23eeba526a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c5f708-a81b-48cc-b9fa-cff0196be33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c5f708-a81b-48cc-b9fa-cff0196be33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279bed83-a236-461d-b9e5-18addeabce34', 'volume_name': 'volume-279bed83-a236-461d-b9e5-18addeabce34', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a5fc62-c0a0-41d5-8dc8-aa0e1a494118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a5fc62-c0a0-41d5-8dc8-aa0e1a494118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ea0919-8d89-4679-a797-cfbe3ea28107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:42 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume 279bed83-a236-461d-b9e5-18addeabce34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279bed83-a236-461d-b9e5-18addeabce34', 'volume_size': 1} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:42 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45" returned: 0 in 0.634s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7c17e7-a879-44df-a589-30490653d6aa]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:42 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 Sep 01 01:15:42 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (64db33e4-9af3-41f1-bb77-aebedc879e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da301ed-ed3f-4e2a-bbdd-d7163b898fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da301ed-ed3f-4e2a-bbdd-d7163b898fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-648052262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07aafbef-a4c5-4822-88d4-954f516b45db,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:42Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffeb638-aea8-4879-9be9-5ee10cb55527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffeb638-aea8-4879-9be9-5ee10cb55527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e6ea8a-7120-4b63-9beb-df91bef59aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.image.glance [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Creating Keystone auth plugin from conf {{(pid=87064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e6ea8a-7120-4b63-9beb-df91bef59aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07aafbef-a4c5-4822-88d4-954f516b45db', 'volume_name': 'volume-07aafbef-a4c5-4822-88d4-954f516b45db', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c58640-e964-4359-8fab-f8577b349171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c58640-e964-4359-8fab-f8577b349171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ff223b-cdee-44c9-a864-44b22e23dd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:42 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Volume 07aafbef-a4c5-4822-88d4-954f516b45db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07aafbef-a4c5-4822-88d4-954f516b45db', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Trying to clone 07aafbef-a4c5-4822-88d4-954f516b45db from image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]). {{(pid=87064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:15:42 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61" returned: 0 in 0.577s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:42 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 Sep 01 01:15:42 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:15:43 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Image download 20.69 MB at 20.69 MB/s Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[100dcfaf-2bbc-4d44-8be9-f2877d36380e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:43 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45" returned: 0 in 0.530s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:43 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45 Sep 01 01:15:43 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:43 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD Sep 01 01:15:43 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:43 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:43 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Temporary image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 is fetched for user d100af495ec54f30b7f237c4dc53568f. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61.472f3012-bbc3-4774-b7aa-aa135a186b45" returned: 0 in 0.326s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Lock "cinder-quobyte-472f3012-bbc3-4774-b7aa-aa135a186b45" released by "_delete_snapshot" :: held 2.203s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28957e8-de6c-4a59-bfa4-49945223dd6e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.733s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.623s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1939227032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279bed83-a236-461d-b9e5-18addeabce34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:42Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Creating volume 279bed83-a236-461d-b9e5-18addeabce34 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:15:43 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8a905d-111c-4cdb-9adf-9e3933e37f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e63097c8-862b-4df9-85c6-3ab6bf554556', 'volume_size': 2, 'source_volid': '0b9f6db2-2ab2-4706-b0b6-175beff8aa61', 'source_volstatus': 'available'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:43 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 1073741824 Sep 01 01:15:43 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff23952-55db-4e9c-afb3-147999434480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:43 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Volume volume-e63097c8-862b-4df9-85c6-3ab6bf554556 (e63097c8-862b-4df9-85c6-3ab6bf554556): created successfully Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff23952-55db-4e9c-afb3-147999434480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Flow 'volume_create_manager' (e6baa73c-b7f5-43ed-8ed0-432476e73128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:43 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD Sep 01 01:15:43 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:43 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b7a1a94f-7e3a-4583-86d3-615522837e81 tempest-VolumesCloneTest-1086301818 None] Created volume successfully. Sep 01 01:15:44 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Acquiring lock "cinder-e63097c8-862b-4df9-85c6-3ab6bf554556-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Lock "cinder-e63097c8-862b-4df9-85c6-3ab6bf554556-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Acquiring lock "cinder-quobyte-e63097c8-862b-4df9-85c6-3ab6bf554556" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Lock "cinder-quobyte-e63097c8-862b-4df9-85c6-3ab6bf554556" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b4263e-94e5-4cc8-9d64-916ea06f7e75]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:44 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 1073741824" returned: 0 in 0.642s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:44 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556 Sep 01 01:15:44 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:44 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 Sep 01 01:15:44 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:44 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34" returned: 0 in 0.335s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-648052262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07aafbef-a4c5-4822-88d4-954f516b45db,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:42Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Creating volume 07aafbef-a4c5-4822-88d4-954f516b45db {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:15:44 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ea0919-8d89-4679-a797-cfbe3ea28107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279bed83-a236-461d-b9e5-18addeabce34', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337c1787-95a6-42b6-8608-06a55ec08d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:44 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:44 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db 1073741824 Sep 01 01:15:44 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556" returned: 0 in 0.529s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:44 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume volume-279bed83-a236-461d-b9e5-18addeabce34 (279bed83-a236-461d-b9e5-18addeabce34): created successfully Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337c1787-95a6-42b6-8608-06a55ec08d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (68bfa562-40be-40ae-a5a3-1ca2eac2c137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:44 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556 Sep 01 01:15:44 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:44 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a54419ec-3552-4da0-aed4-b3ea5f6190da tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created volume successfully. Sep 01 01:15:45 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e63097c8-862b-4df9-85c6-3ab6bf554556" returned: 0 in 0.360s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Lock "cinder-quobyte-e63097c8-862b-4df9-85c6-3ab6bf554556" released by "delete_volume" :: held 0.953s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Created reservations ['7e5b436f-f541-456c-a28c-bbacd854b548', '3e9f1387-14de-492d-945c-36cb267ed5b8', 'd2657e93-f728-4e14-816f-19125be472ca', 'daae69de-41b3-404b-b8fa-ab88106cb375'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:45 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db 1073741824" returned: 0 in 0.659s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:45 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:15:45 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:45 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db Sep 01 01:15:45 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:45 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.370s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:15:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Deleted volume successfully. Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-52be08d4-19b1-4a06-bead-e95f99625177 tempest-VolumesCloneTest-1086301818 None] Lock "cinder-e63097c8-862b-4df9-85c6-3ab6bf554556-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:45 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db" returned: 0 in 0.369s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.471s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Creating offline snapshot 78339df3-7571-4549-8d39-0173b7669615 of volume 279bed83-a236-461d-b9e5-18addeabce34 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Attempting download of 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}])) to volume 07aafbef-a4c5-4822-88d4-954f516b45db. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2378c7ce-3238-4697-baa3-7da2d867b22f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[452d4303-93f8-488d-86f3-30150628160c]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2oj298j8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:46 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 Sep 01 01:15:46 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:46 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2oj298j8 Sep 01 01:15:46 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:46 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2oj298j8" returned: 0 in 0.382s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2oj298j8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:46 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34" returned: 0 in 0.452s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:46 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 1G Sep 01 01:15:46 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:46 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2oj298j8 Sep 01 01:15:46 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Acquiring lock "cinder-0b9f6db2-2ab2-4706-b0b6-175beff8aa61-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Lock "cinder-0b9f6db2-2ab2-4706-b0b6-175beff8aa61-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Acquiring lock "cinder-quobyte-0b9f6db2-2ab2-4706-b0b6-175beff8aa61" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Lock "cinder-quobyte-0b9f6db2-2ab2-4706-b0b6-175beff8aa61" acquired by "delete_volume" :: waited 0.032s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2a899f-77cf-4735-b7d7-9a26e3ce354a]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:46 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2oj298j8" returned: 1 in 0.544s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_2oj298j8' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef00b50a-5bef-4db5-a560-7e69633afd15]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:47 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 Sep 01 01:15:47 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:47 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD Sep 01 01:15:47 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:47 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 1G" returned: 0 in 0.776s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279bed83-a236-461d-b9e5-18addeabce34 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:47 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279bed83-a236-461d-b9e5-18addeabce34 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 Sep 01 01:15:47 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:47 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61" returned: 0 in 0.473s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:47 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61 Sep 01 01:15:47 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:47 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 was qcow2, converting to qcow2 {{(pid=87064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:47 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db Sep 01 01:15:47 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:47 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279bed83-a236-461d-b9e5-18addeabce34 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615" returned: 0 in 0.505s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:47 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 is being set with open permissions: ugo+rw Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:47 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 Sep 01 01:15:47 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:47 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0b9f6db2-2ab2-4706-b0b6-175beff8aa61" returned: 0 in 0.383s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Lock "cinder-quobyte-0b9f6db2-2ab2-4706-b0b6-175beff8aa61" released by "delete_volume" :: held 0.946s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Created reservations ['d6bd9d51-385a-499f-bce7-1e7868cabde3', 'cf9c3970-94a4-494d-b907-401d0660e53b', 'ee5947b5-52be-4f6a-a026-d3311aff44eb', '6941dc37-452a-493c-87f5-5b4797b49b89'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:48 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:15:48 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:48 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615" returned: 0 in 0.354s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:48 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.info Sep 01 01:15:48 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:48 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.326s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:48 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:15:48 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Deleted volume successfully. Sep 01 01:15:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0ac3d931-0ef9-497c-95da-629fdf57083b tempest-VolumesCloneTest-1086301818 None] Lock "cinder-0b9f6db2-2ab2-4706-b0b6-175beff8aa61-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:48 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.info" returned: 0 in 0.306s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:48 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.info is being set with open permissions: ugo+rw Sep 01 01:15:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:48 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.info Sep 01 01:15:48 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:48 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.info" returned: 0 in 0.364s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.881s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:48 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-23243b2a-e5c2-4308-bfea-0c5551ae7da0 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Create snapshot completed successfully Sep 01 01:15:49 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db" returned: 0 in 2.449s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:49 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_1e6py8gedevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:15:49 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Converted 112.00 MB image at 45.72 MB/s Sep 01 01:15:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:49 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db 1G Sep 01 01:15:49 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:50 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db 1G" returned: 0 in 0.600s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Downloaded image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}])) to volume 07aafbef-a4c5-4822-88d4-954f516b45db successfully. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Temporary image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 for user d100af495ec54f30b7f237c4dc53568f is deleted. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Marking volume 07aafbef-a4c5-4822-88d4-954f516b45db as bootable. {{(pid=87064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (bc240552-99db-4729-aad3-14b2d0dc85a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9e7b55-bb36-4716-9b39-9a1583a8035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Copying metadata from image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 to 07aafbef-a4c5-4822-88d4-954f516b45db. {{(pid=87064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Creating volume glance metadata for volume 07aafbef-a4c5-4822-88d4-954f516b45db backed by image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9e7b55-bb36-4716-9b39-9a1583a8035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676654625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef9b25e-ac26-47af-96ca-0e6752445d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:50Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554599c0-222a-43a8-a4b3-0dd93fce55c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554599c0-222a-43a8-a4b3-0dd93fce55c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9708f891-f4ca-46e4-82e3-d70177e6adf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9708f891-f4ca-46e4-82e3-d70177e6adf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef9b25e-ac26-47af-96ca-0e6752445d8f', 'volume_name': 'volume-cef9b25e-ac26-47af-96ca-0e6752445d8f', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cf6d27-023d-44d1-8004-01f40fb0a978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cf6d27-023d-44d1-8004-01f40fb0a978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f520a2-724e-4ce3-9088-0f1362b4133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:50 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume cef9b25e-ac26-47af-96ca-0e6752445d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef9b25e-ac26-47af-96ca-0e6752445d8f', 'volume_size': 1} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676654625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef9b25e-ac26-47af-96ca-0e6752445d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:50Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Creating volume cef9b25e-ac26-47af-96ca-0e6752445d8f {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:15:50 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:50 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f 1073741824 Sep 01 01:15:50 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ff223b-cdee-44c9-a864-44b22e23dd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07aafbef-a4c5-4822-88d4-954f516b45db', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57b3f27-1a4d-4f0e-ba21-22d03dfe0746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:50 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Volume volume-07aafbef-a4c5-4822-88d4-954f516b45db (07aafbef-a4c5-4822-88d4-954f516b45db): created successfully Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57b3f27-1a4d-4f0e-ba21-22d03dfe0746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (64db33e4-9af3-41f1-bb77-aebedc879e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:51 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6784507b-2068-4e39-a302-413c37612a82 tempest-VolumesGetTest-1952230569 None] Created volume successfully. Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (8b57553e-2794-43d1-9b97-f3296b81898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f589823-2854-4618-9c38-7aa7171b8eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f589823-2854-4618-9c38-7aa7171b8eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208366861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fa08e7-c48c-4133-9a87-124b0d4b28a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:51Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c1572c-bf65-4f8c-ae98-ae8dcb053306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c1572c-bf65-4f8c-ae98-ae8dcb053306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea7c16c-d4c8-4617-84b0-b51fa3aed604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea7c16c-d4c8-4617-84b0-b51fa3aed604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42fa08e7-c48c-4133-9a87-124b0d4b28a3', 'volume_name': 'volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e453e90a-a095-4ba7-b16d-d6736cb8ddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e453e90a-a095-4ba7-b16d-d6736cb8ddf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82cd64e-c834-4491-b166-ca5bda95ac38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:51 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume 42fa08e7-c48c-4133-9a87-124b0d4b28a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3', 'volume_size': 1} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:51 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f 1073741824" returned: 0 in 1.001s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:51 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f Sep 01 01:15:51 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:51 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (cf569085-debf-4022-85f4-a7c3090af5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fe075c-0eba-4bb8-a413-144671f5c847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fe075c-0eba-4bb8-a413-144671f5c847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01aaaea-6899-44da-b932-8c247d11de1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:52Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4caf7f78-3903-4752-9d71-29022c4c2232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4caf7f78-3903-4752-9d71-29022c4c2232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4226c7e3-4099-4e74-9f79-cf76df78458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4226c7e3-4099-4e74-9f79-cf76df78458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01aaaea-6899-44da-b932-8c247d11de1d', 'volume_name': 'volume-f01aaaea-6899-44da-b932-8c247d11de1d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c720a5b2-6649-4a17-a349-6bc740558d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c720a5b2-6649-4a17-a349-6bc740558d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ba11ec-fdc0-4e1d-aaf7-384624f64090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume f01aaaea-6899-44da-b932-8c247d11de1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01aaaea-6899-44da-b932-8c247d11de1d', 'volume_size': 1} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:52 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f" returned: 0 in 0.419s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.811s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208366861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fa08e7-c48c-4133-9a87-124b0d4b28a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:51Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Creating volume 42fa08e7-c48c-4133-9a87-124b0d4b28a3 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:15:52 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f520a2-724e-4ce3-9088-0f1362b4133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef9b25e-ac26-47af-96ca-0e6752445d8f', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59329eb6-8b03-4e05-b3cf-f7f71dbc3d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume volume-cef9b25e-ac26-47af-96ca-0e6752445d8f (cef9b25e-ac26-47af-96ca-0e6752445d8f): created successfully Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59329eb6-8b03-4e05-b3cf-f7f71dbc3d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (bc240552-99db-4729-aad3-14b2d0dc85a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:52 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3 1073741824 Sep 01 01:15:52 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:52 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c16542c2-37e5-4541-9b6c-b36a12a627ea tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created volume successfully. Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (68226ab3-6b73-456e-8d4e-9866a068c275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec944915-9c1f-49f7-b739-d6d0baea91f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec944915-9c1f-49f7-b739-d6d0baea91f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237717007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c269d62c-d808-497c-88ce-25336dd62bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:52Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7b7866-110e-4f3c-9675-3c0b0774ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7b7866-110e-4f3c-9675-3c0b0774ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8492f22-5cc1-46d2-8fed-8deb389d9b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8492f22-5cc1-46d2-8fed-8deb389d9b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c269d62c-d808-497c-88ce-25336dd62bec', 'volume_name': 'volume-c269d62c-d808-497c-88ce-25336dd62bec', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc966c4b-2776-46f8-b8ed-18b27486301d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc966c4b-2776-46f8-b8ed-18b27486301d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af306a3-e977-4c16-b527-dba69b043e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume c269d62c-d808-497c-88ce-25336dd62bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c269d62c-d808-497c-88ce-25336dd62bec', 'volume_size': 1} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:52 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:15:52 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:53 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3 1073741824" returned: 0 in 0.846s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:53 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3 Sep 01 01:15:53 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:53 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.742s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (3cac8ace-f285-4388-9c9a-940d0cfb38ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066acb58-b630-444a-972e-a68433b5b101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066acb58-b630-444a-972e-a68433b5b101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919207789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d034144-1baa-458d-88ce-2a5cf4e688f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:53Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511c9275-4bf8-4fa3-89d8-40a328898679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511c9275-4bf8-4fa3-89d8-40a328898679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e790dc4-8629-46bf-88f3-5e2905da541f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e790dc4-8629-46bf-88f3-5e2905da541f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d034144-1baa-458d-88ce-2a5cf4e688f3', 'volume_name': 'volume-0d034144-1baa-458d-88ce-2a5cf4e688f3', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26ff8b0-9c12-46b3-992b-fcc1d5ac8097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26ff8b0-9c12-46b3-992b-fcc1d5ac8097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f90bc4-2383-48ea-b082-2e62736bfc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:53 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume 0d034144-1baa-458d-88ce-2a5cf4e688f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d034144-1baa-458d-88ce-2a5cf4e688f3', 'volume_size': 1} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:53 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3" returned: 0 in 0.500s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01aaaea-6899-44da-b932-8c247d11de1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:52Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Creating volume f01aaaea-6899-44da-b932-8c247d11de1d {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:15:53 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:53 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d 1073741824 Sep 01 01:15:53 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82cd64e-c834-4491-b166-ca5bda95ac38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5452c0c6-a7f3-4031-a3eb-b44128636e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:53 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3 (42fa08e7-c48c-4133-9a87-124b0d4b28a3): created successfully Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5452c0c6-a7f3-4031-a3eb-b44128636e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (8b57553e-2794-43d1-9b97-f3296b81898c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:53 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7267a2f4-a6f3-4f3b-84ba-e218a28ccf18 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created volume successfully. Sep 01 01:15:53 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (b53c3643-f0a6-4bf8-9e99-81db5653d7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c03b4f-9d1e-4b43-a609-2f3f0a94f84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c03b4f-9d1e-4b43-a609-2f3f0a94f84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1542176213',display_name='tempest-VolumesGetTest-Volume-455926370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7159299-2511-437e-af47-6bd5c3066c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:54Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d95a35-6b74-4ef6-8ddb-4f4e03ac1284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d95a35-6b74-4ef6-8ddb-4f4e03ac1284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ac1593-4932-4084-b116-3839fb9c8fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ac1593-4932-4084-b116-3839fb9c8fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7159299-2511-437e-af47-6bd5c3066c3f', 'volume_name': 'volume-d7159299-2511-437e-af47-6bd5c3066c3f', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954e4866-9907-44cb-8c66-63025f13c300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954e4866-9907-44cb-8c66-63025f13c300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903b54e5-b18f-465e-912f-a36dcb98467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:54 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Volume d7159299-2511-437e-af47-6bd5c3066c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7159299-2511-437e-af47-6bd5c3066c3f', 'volume_size': 1} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:54 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d 1073741824" returned: 0 in 0.650s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:54 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d Sep 01 01:15:54 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:54 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d" returned: 0 in 0.329s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.116s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237717007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c269d62c-d808-497c-88ce-25336dd62bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:52Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Creating volume c269d62c-d808-497c-88ce-25336dd62bec {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:15:54 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:54 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec 1073741824 Sep 01 01:15:54 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ba11ec-fdc0-4e1d-aaf7-384624f64090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01aaaea-6899-44da-b932-8c247d11de1d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9350c564-586c-4681-beb1-85e82f3d4b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:54 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume volume-f01aaaea-6899-44da-b932-8c247d11de1d (f01aaaea-6899-44da-b932-8c247d11de1d): created successfully Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9350c564-586c-4681-beb1-85e82f3d4b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (cf569085-debf-4022-85f4-a7c3090af5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a365fbd9-0c25-4015-bf5a-c361ef6de1fc tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created volume successfully. Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Flow 'volume_create_manager' (39f4249e-c622-455b-94ef-a22f8c5b3710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42229c8-ad64-44b0-9299-e318e1457986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42229c8-ad64-44b0-9299-e318e1457986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1486986370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b53ecc-1957-453a-a70a-58423e8a57f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28d3421b71944d6d9144391413b5c2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:55Z,use_quota=True,user_id='a9ff287994b54a928f443aa9dc05225f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d27a520-0d7a-4466-97ba-3a4e6b007444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d27a520-0d7a-4466-97ba-3a4e6b007444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f977879f-0bb1-4e7e-b227-cb1330e7cd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.image.glance [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Creating Keystone auth plugin from conf {{(pid=87064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:15:55 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec 1073741824" returned: 0 in 0.616s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:55 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec Sep 01 01:15:55 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f977879f-0bb1-4e7e-b227-cb1330e7cd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9b53ecc-1957-453a-a70a-58423e8a57f7', 'volume_name': 'volume-b9b53ecc-1957-453a-a70a-58423e8a57f7', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b34ec9-2da5-4879-9104-c60112bad2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b34ec9-2da5-4879-9104-c60112bad2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add496f5-59ca-4b6e-9ef5-17d7f9ae99d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:55 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Volume b9b53ecc-1957-453a-a70a-58423e8a57f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9b53ecc-1957-453a-a70a-58423e8a57f7', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Trying to clone b9b53ecc-1957-453a-a70a-58423e8a57f7 from image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]). {{(pid=87064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:15:55 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec" returned: 0 in 0.322s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.168s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919207789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d034144-1baa-458d-88ce-2a5cf4e688f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46b38125e7042cebdeefa66dc7b10e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:53Z,use_quota=True,user_id='75e3549b133b4e4488e4e03ca50d0cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Creating volume 0d034144-1baa-458d-88ce-2a5cf4e688f3 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:15:55 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:55 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3 1073741824 Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af306a3-e977-4c16-b527-dba69b043e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c269d62c-d808-497c-88ce-25336dd62bec', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:55 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f908d64-ad81-423f-b210-c97e52489e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:55 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume volume-c269d62c-d808-497c-88ce-25336dd62bec (c269d62c-d808-497c-88ce-25336dd62bec): created successfully Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f908d64-ad81-423f-b210-c97e52489e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (68226ab3-6b73-456e-8d4e-9866a068c275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5c86fe0d-6078-4b51-b19a-f0fff3b7efbb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created volume successfully. Sep 01 01:15:55 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:15:55 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Image download 20.69 MB at 20.69 MB/s Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b3af93-c709-43ce-a37a-a6186c973e14]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:56 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD Sep 01 01:15:56 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:56 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Temporary image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 is fetched for user a9ff287994b54a928f443aa9dc05225f. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:15:56 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3 1073741824" returned: 0 in 0.625s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:56 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3 Sep 01 01:15:56 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9984b26f-6587-487c-9452-44806290870f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:56 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD Sep 01 01:15:56 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:56 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3" returned: 0 in 0.367s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.785s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1542176213',display_name='tempest-VolumesGetTest-Volume-455926370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7159299-2511-437e-af47-6bd5c3066c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8f24635af947f0a7487e88c1617056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:54Z,use_quota=True,user_id='d100af495ec54f30b7f237c4dc53568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Creating volume d7159299-2511-437e-af47-6bd5c3066c3f {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:15:56 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:56 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f 1073741824 Sep 01 01:15:56 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f90bc4-2383-48ea-b082-2e62736bfc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d034144-1baa-458d-88ce-2a5cf4e688f3', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95dbf3d8-38aa-4f79-a81b-5dfd4863aa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:56 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Volume volume-0d034144-1baa-458d-88ce-2a5cf4e688f3 (0d034144-1baa-458d-88ce-2a5cf4e688f3): created successfully Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95dbf3d8-38aa-4f79-a81b-5dfd4863aa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Flow 'volume_create_manager' (3cac8ace-f285-4388-9c9a-940d0cfb38ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:56 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-606ea7c1-47a5-48cb-8277-8592ed90c915 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created volume successfully. Sep 01 01:15:57 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD" returned: 0 in 0.562s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:57 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f 1073741824" returned: 0 in 0.586s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:57 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f Sep 01 01:15:57 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:57 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f" returned: 0 in 0.399s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1486986370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b53ecc-1957-453a-a70a-58423e8a57f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28d3421b71944d6d9144391413b5c2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:55Z,use_quota=True,user_id='a9ff287994b54a928f443aa9dc05225f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Creating volume b9b53ecc-1957-453a-a70a-58423e8a57f7 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:15:57 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903b54e5-b18f-465e-912f-a36dcb98467a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7159299-2511-437e-af47-6bd5c3066c3f', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3811fab-2f15-4728-8d5f-b9a1bff48499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:58 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 1073741824 Sep 01 01:15:58 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:58 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Volume volume-d7159299-2511-437e-af47-6bd5c3066c3f (d7159299-2511-437e-af47-6bd5c3066c3f): created successfully Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3811fab-2f15-4728-8d5f-b9a1bff48499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Flow 'volume_create_manager' (b53c3643-f0a6-4bf8-9e99-81db5653d7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-0d034144-1baa-458d-88ce-2a5cf4e688f3-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:58 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-aa44d590-c9a2-4357-afff-07e5041e80d4 tempest-VolumesGetTest-1952230569 None] Created volume successfully. Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-0d034144-1baa-458d-88ce-2a5cf4e688f3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-quobyte-0d034144-1baa-458d-88ce-2a5cf4e688f3" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-0d034144-1baa-458d-88ce-2a5cf4e688f3" acquired by "delete_volume" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d50d4-cbce-443a-9a0c-a3e4c4c70d98]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Flow 'volume_create_manager' (3826090e-7e14-4a46-996b-3458ad515912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff1c8fe-65dc-4bb6-acf4-a67e335ca18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff1c8fe-65dc-4bb6-acf4-a67e335ca18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf711da-671a-4d8d-ba28-f645545cede1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af610a84991c496b85864040c53bf160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:58Z,use_quota=True,user_id='273a7f9a4d8d4d6b9930986447c35c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe81e749-8643-469c-9a70-6b7810f8970f),volume_type_id=fe81e749-8643-469c-9a70-6b7810f8970f)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaad9ce5-9900-4ee2-a937-9af19ab4fa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaad9ce5-9900-4ee2-a937-9af19ab4fa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e63ace-0924-490f-9a8e-69802013a29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.image.glance [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Creating Keystone auth plugin from conf {{(pid=87064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:15:58 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3 Sep 01 01:15:58 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-d7159299-2511-437e-af47-6bd5c3066c3f-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Lock "cinder-d7159299-2511-437e-af47-6bd5c3066c3f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-quobyte-d7159299-2511-437e-af47-6bd5c3066c3f" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-d7159299-2511-437e-af47-6bd5c3066c3f" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab80efa-a5ec-4be2-9f27-69b59b9ae70f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e63ace-0924-490f-9a8e-69802013a29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2cf711da-671a-4d8d-ba28-f645545cede1', 'volume_name': 'volume-2cf711da-671a-4d8d-ba28-f645545cede1', 'volume_size': 1, 'image_id': '5b474a09-0725-44e7-a075-c82e73e2f238', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b474a09-0725-44e7-a075-c82e73e2f238', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'de5cf6a027ce1db9583a450ca1623ed2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af610a84991c496b85864040c53bf160', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9611f6d681144001a791b54ff9435acdd0a0661cfeb12f1074476b4a28fa554db4835b6af7f4beea2fe65bec20d00c5ae95227d7c6c103c17b42674ed4eec64', 'id': '5b474a09-0725-44e7-a075-c82e73e2f238', 'created_at': datetime.datetime(2026, 8, 31, 23, 15, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b474a09-0725-44e7-a075-c82e73e2f238/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:58 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8fe905-09d2-484b-84c8-0e81b9c6a54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8fe905-09d2-484b-84c8-0e81b9c6a54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73c20c4-bb3f-46db-b744-a3406d8b5c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:15:58 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Volume 2cf711da-671a-4d8d-ba28-f645545cede1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2cf711da-671a-4d8d-ba28-f645545cede1', 'volume_size': 1, 'image_id': '5b474a09-0725-44e7-a075-c82e73e2f238', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b474a09-0725-44e7-a075-c82e73e2f238', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'de5cf6a027ce1db9583a450ca1623ed2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af610a84991c496b85864040c53bf160', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9611f6d681144001a791b54ff9435acdd0a0661cfeb12f1074476b4a28fa554db4835b6af7f4beea2fe65bec20d00c5ae95227d7c6c103c17b42674ed4eec64', 'id': '5b474a09-0725-44e7-a075-c82e73e2f238', 'created_at': datetime.datetime(2026, 8, 31, 23, 15, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b474a09-0725-44e7-a075-c82e73e2f238/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Trying to clone 2cf711da-671a-4d8d-ba28-f645545cede1 from image 5b474a09-0725-44e7-a075-c82e73e2f238 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5b474a09-0725-44e7-a075-c82e73e2f238', 'metadata': {}}]). {{(pid=87064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 1073741824" returned: 0 in 0.960s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:58 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f Sep 01 01:15:58 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:58 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3" returned: 0 in 0.678s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:59 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 Sep 01 01:15:59 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:59 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3 Sep 01 01:15:59 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:15:59 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Image download 0.00 MB at 0.00 MB/s Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d1e6ee-7b83-47ec-a34c-6a2db443f82b]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:59 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD Sep 01 01:15:59 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:59 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f" returned: 0 in 0.499s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:59 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f Sep 01 01:15:59 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:59 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7" returned: 0 in 0.375s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:59 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d034144-1baa-458d-88ce-2a5cf4e688f3" returned: 0 in 0.378s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-0d034144-1baa-458d-88ce-2a5cf4e688f3" released by "delete_volume" :: held 1.164s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Attempting download of 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}])) to volume b9b53ecc-1957-453a-a70a-58423e8a57f7. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bc13a1-2337-421d-aa49-e4aec021e693]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_88j3pm66 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created reservations ['8bb01533-3a71-4d99-acb5-a006820a14cd', 'a1a5c529-85d9-4497-aaf3-0ae8a7665f54', 'cd16e9f4-27e9-409c-9ddc-5ffe9b00f5f6', '75345d68-190e-4c21-8882-fabbce8cd125'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:15:59 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD" returned: 0 in 0.631s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:15:59 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_88j3pm66 Sep 01 01:15:59 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:59 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:15:59 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:59 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d7159299-2511-437e-af47-6bd5c3066c3f" returned: 0 in 0.592s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:15:59 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD Sep 01 01:15:59 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-d7159299-2511-437e-af47-6bd5c3066c3f" released by "delete_volume" :: held 1.161s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:15:59 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Created reservations ['2d43185a-e83c-42b8-b020-308869203c0a', '63e48bca-a788-40d0-815c-cd3abc7eba67', 'f9ba596b-4ab9-427e-af70-44d09fb0d9ed', '838454a8-b1ae-4f35-a000-e7fcd81fe4c2'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:00 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_88j3pm66" returned: 0 in 0.525s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_88j3pm66 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:00 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.377s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Deleted volume successfully. Sep 01 01:16:00 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:00 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fb2cbd1-3b19-4575-a7dc-2850a85e2bd3 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-0d034144-1baa-458d-88ce-2a5cf4e688f3-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:00 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_88j3pm66 Sep 01 01:16:00 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:00 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD" returned: 1 in 0.475s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Temporary image 5b474a09-0725-44e7-a075-c82e73e2f238 is fetched for user 273a7f9a4d8d4d6b9930986447c35c3d. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[977d59c5-19ee-402a-8e1e-d4684c190e99]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:00 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD Sep 01 01:16:00 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:00 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.356s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Deleted volume successfully. Sep 01 01:16:00 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_88j3pm66" returned: 1 in 0.453s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_88j3pm66' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cdef01-7bd5-4c0f-92f6-9e793f65bdf0]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-89188365-1ed5-447f-be6c-ace7e1c29b2a tempest-VolumesGetTest-1952230569 None] Lock "cinder-d7159299-2511-437e-af47-6bd5c3066c3f-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-c269d62c-d808-497c-88ce-25336dd62bec-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-c269d62c-d808-497c-88ce-25336dd62bec-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-quobyte-c269d62c-d808-497c-88ce-25336dd62bec" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-c269d62c-d808-497c-88ce-25336dd62bec" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:00 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD Sep 01 01:16:00 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea84c41-70b7-4604-abff-2665a23d37bc]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:00 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:00 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec Sep 01 01:16:00 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:00 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD Sep 01 01:16:00 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:01 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 was qcow2, converting to qcow2 {{(pid=87064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:01 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 Sep 01 01:16:01 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-07aafbef-a4c5-4822-88d4-954f516b45db-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Lock "cinder-07aafbef-a4c5-4822-88d4-954f516b45db-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:01 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD" returned: 1 in 0.440s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf711da-671a-4d8d-ba28-f645545cede1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af610a84991c496b85864040c53bf160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:15:58Z,use_quota=True,user_id='273a7f9a4d8d4d6b9930986447c35c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe81e749-8643-469c-9a70-6b7810f8970f),volume_type_id=fe81e749-8643-469c-9a70-6b7810f8970f)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Creating volume 2cf711da-671a-4d8d-ba28-f645545cede1 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:16:01 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:01 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 1073741824 Sep 01 01:16:01 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Acquiring lock "cinder-quobyte-07aafbef-a4c5-4822-88d4-954f516b45db" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:01 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec" returned: 0 in 0.539s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-07aafbef-a4c5-4822-88d4-954f516b45db" acquired by "delete_volume" :: waited 0.042s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:01 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec Sep 01 01:16:01 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad663722-d0ac-4477-8ddb-1ac3d1f901bc]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:01 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db Sep 01 01:16:01 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:01 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c269d62c-d808-497c-88ce-25336dd62bec" returned: 0 in 0.414s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-c269d62c-d808-497c-88ce-25336dd62bec" released by "delete_volume" :: held 1.044s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:01 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 1073741824" returned: 0 in 0.637s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:01 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db" returned: 0 in 0.554s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created reservations ['77b87c4e-b973-4145-af91-ae95613022cb', 'b8edc264-576d-4d7e-88a0-db34fecb3fb7', 'e6f53490-aa68-40f9-a6b5-cd54f8142715', '2d2f2c82-a067-4bc0-afcf-0a11c2e04e91'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:01 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db Sep 01 01:16:01 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:02 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 Sep 01 01:16:02 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:02 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:02 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:02 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-07aafbef-a4c5-4822-88d4-954f516b45db" returned: 0 in 0.373s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Lock "cinder-quobyte-07aafbef-a4c5-4822-88d4-954f516b45db" released by "delete_volume" :: held 0.991s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Created reservations ['e5f6dd9f-2258-446f-acc5-3df0ef28f8d8', '7583d72b-d171-45bb-8da5-8491239c47af', '8bae9773-1b4d-452e-90b7-577f59ae5bd9', 'c7020265-1b6d-4b1e-8e90-7e083078ed9b'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:02 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1" returned: 0 in 0.447s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Attempting download of 5b474a09-0725-44e7-a075-c82e73e2f238 ((None, [{'url': 'file:///opt/stack/data/glance/images/5b474a09-0725-44e7-a075-c82e73e2f238', 'metadata': {}}])) to volume 2cf711da-671a-4d8d-ba28-f645545cede1. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc74dcd3-4599-4e23-985e-88fb927ccee5]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b474a09-0725-44e7-a075-c82e73e2f238_uh5jcjfn {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:02 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.471s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:02 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:02 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Deleted volume successfully. Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d29887d2-3671-4238-9d22-52df292c1df9 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-c269d62c-d808-497c-88ce-25336dd62bec-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:02 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b474a09-0725-44e7-a075-c82e73e2f238_uh5jcjfn Sep 01 01:16:02 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:02 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-f01aaaea-6899-44da-b932-8c247d11de1d-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.409s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Deleted volume successfully. Sep 01 01:16:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-f01aaaea-6899-44da-b932-8c247d11de1d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5ab799cf-f744-4f37-85e4-5d3ad44a1ba5 tempest-VolumesGetTest-1952230569 None] Lock "cinder-07aafbef-a4c5-4822-88d4-954f516b45db-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-quobyte-f01aaaea-6899-44da-b932-8c247d11de1d" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-f01aaaea-6899-44da-b932-8c247d11de1d" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:03 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b474a09-0725-44e7-a075-c82e73e2f238_uh5jcjfn" returned: 0 in 0.518s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b474a09-0725-44e7-a075-c82e73e2f238_uh5jcjfn {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[969d8d80-b078-4af0-a572-7ed41f6a51cd]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:03 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b474a09-0725-44e7-a075-c82e73e2f238_uh5jcjfn Sep 01 01:16:03 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:03 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d Sep 01 01:16:03 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:03 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b474a09-0725-44e7-a075-c82e73e2f238_uh5jcjfn" returned: 1 in 0.441s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b474a09-0725-44e7-a075-c82e73e2f238_uh5jcjfn' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:16:03 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac09436e-1986-4f3e-9fa7-e23439bcfdc9]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7" returned: 0 in 2.529s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5aa92ea2-a5d8-46f6-9949-7c665ebdeb00_wkb_wxhgdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:16:03 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Converted 112.00 MB image at 44.22 MB/s Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:03 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:03 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 1G Sep 01 01:16:03 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d" returned: 0 in 0.502s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:03 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d Sep 01 01:16:03 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:03 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD Sep 01 01:16:03 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:04 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f01aaaea-6899-44da-b932-8c247d11de1d" returned: 0 in 0.469s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:04 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 1G" returned: 0 in 0.535s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:04 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Downloaded image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 ((None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}])) to volume b9b53ecc-1957-453a-a70a-58423e8a57f7 successfully. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Temporary image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 for user a9ff287994b54a928f443aa9dc05225f is deleted. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Marking volume b9b53ecc-1957-453a-a70a-58423e8a57f7 as bootable. {{(pid=87064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-f01aaaea-6899-44da-b932-8c247d11de1d" released by "delete_volume" :: held 1.060s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD" returned: 0 in 0.590s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Copying metadata from image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 to b9b53ecc-1957-453a-a70a-58423e8a57f7. {{(pid=87064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Creating volume glance metadata for volume b9b53ecc-1957-453a-a70a-58423e8a57f7 backed by image 5aa92ea2-a5d8-46f6-9949-7c665ebdeb00 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created reservations ['d451e29b-80f5-4e86-bf2c-8d78a9c8303b', 'b04c3281-ff1c-448c-85e0-77787655575a', '2bf1d1ae-c83c-4539-ab8b-d32f2a1ab287', '85bb06aa-0095-4356-b1d3-38ca27e7cc36'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:04 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD Sep 01 01:16:04 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add496f5-59ca-4b6e-9ef5-17d7f9ae99d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b53ecc-1957-453a-a70a-58423e8a57f7', 'volume_size': 1, 'image_id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47378172afd0426c89be41d81509c7b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5aa92ea2-a5d8-46f6-9949-7c665ebdeb00', 'created_at': datetime.datetime(2026, 8, 31, 22, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5aa92ea2-a5d8-46f6-9949-7c665ebdeb00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a15c7a4-64a0-446f-a5d0-b98a02c7d598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:04 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Volume volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 (b9b53ecc-1957-453a-a70a-58423e8a57f7): created successfully Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a15c7a4-64a0-446f-a5d0-b98a02c7d598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Flow 'volume_create_manager' (39f4249e-c622-455b-94ef-a22f8c5b3710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:04 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6be0732b-56fa-44cc-a45b-81dbdab00f24 tempest-VolumesExtendTest-680086689 None] Created volume successfully. Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:04 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:04 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:04 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD" returned: 1 in 0.474s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] 5b474a09-0725-44e7-a075-c82e73e2f238 was raw, converting to qcow2 {{(pid=87064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:04 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 Sep 01 01:16:04 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:04 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.431s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:04 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Deleted volume successfully. Sep 01 01:16:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a4367180-c2f0-4907-8272-c773e2aa472a tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-f01aaaea-6899-44da-b932-8c247d11de1d-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-42fa08e7-c48c-4133-9a87-124b0d4b28a3-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-42fa08e7-c48c-4133-9a87-124b0d4b28a3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:05 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1" returned: 0 in 0.756s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5b474a09-0725-44e7-a075-c82e73e2f238_2ukf4zitdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:16:05 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ee645451-65f5-423e-a1dd-daea69d33bee tempest-VolumesExtendTest-680086689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ee645451-65f5-423e-a1dd-daea69d33bee tempest-VolumesExtendTest-680086689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:05 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 1G Sep 01 01:16:05 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-quobyte-42fa08e7-c48c-4133-9a87-124b0d4b28a3" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe6f0e4-7dab-4e73-8d11-a2e878a980e7]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ee645451-65f5-423e-a1dd-daea69d33bee tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-42fa08e7-c48c-4133-9a87-124b0d4b28a3" acquired by "delete_volume" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[308cfd90-252a-444e-b5fa-a7337765eef6]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:05 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 Sep 01 01:16:05 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:05 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3 Sep 01 01:16:05 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:05 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 1G" returned: 0 in 0.469s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Downloaded image 5b474a09-0725-44e7-a075-c82e73e2f238 ((None, [{'url': 'file:///opt/stack/data/glance/images/5b474a09-0725-44e7-a075-c82e73e2f238', 'metadata': {}}])) to volume 2cf711da-671a-4d8d-ba28-f645545cede1 successfully. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Temporary image 5b474a09-0725-44e7-a075-c82e73e2f238 for user 273a7f9a4d8d4d6b9930986447c35c3d is deleted. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Marking volume 2cf711da-671a-4d8d-ba28-f645545cede1 as bootable. {{(pid=87064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Copying metadata from image 5b474a09-0725-44e7-a075-c82e73e2f238 to 2cf711da-671a-4d8d-ba28-f645545cede1. {{(pid=87064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Creating volume glance metadata for volume 2cf711da-671a-4d8d-ba28-f645545cede1 backed by image 5b474a09-0725-44e7-a075-c82e73e2f238 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5b474a09-0725-44e7-a075-c82e73e2f238', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'de5cf6a027ce1db9583a450ca1623ed2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:16:05 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ee645451-65f5-423e-a1dd-daea69d33bee tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7" returned: 0 in 0.531s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ee645451-65f5-423e-a1dd-daea69d33bee tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 2G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73c20c4-bb3f-46db-b744-a3406d8b5c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf711da-671a-4d8d-ba28-f645545cede1', 'volume_size': 1, 'image_id': '5b474a09-0725-44e7-a075-c82e73e2f238', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b474a09-0725-44e7-a075-c82e73e2f238', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'de5cf6a027ce1db9583a450ca1623ed2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af610a84991c496b85864040c53bf160', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9611f6d681144001a791b54ff9435acdd0a0661cfeb12f1074476b4a28fa554db4835b6af7f4beea2fe65bec20d00c5ae95227d7c6c103c17b42674ed4eec64', 'id': '5b474a09-0725-44e7-a075-c82e73e2f238', 'created_at': datetime.datetime(2026, 8, 31, 23, 15, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b474a09-0725-44e7-a075-c82e73e2f238/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be297968-1ce3-40b4-a1f4-394fc47cd49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:06 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Volume volume-2cf711da-671a-4d8d-ba28-f645545cede1 (2cf711da-671a-4d8d-ba28-f645545cede1): created successfully Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be297968-1ce3-40b4-a1f4-394fc47cd49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Flow 'volume_create_manager' (3826090e-7e14-4a46-996b-3458ad515912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3bc8d124-72e3-4c07-a4b5-e0d3f093e4cf tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Created volume successfully. Sep 01 01:16:06 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3" returned: 0 in 0.586s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:06 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3 Sep 01 01:16:06 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ee645451-65f5-423e-a1dd-daea69d33bee tempest-VolumesExtendTest-680086689 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 2G" returned: 0 in 0.160s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ee645451-65f5-423e-a1dd-daea69d33bee tempest-VolumesExtendTest-680086689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.738s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ee645451-65f5-423e-a1dd-daea69d33bee tempest-VolumesExtendTest-680086689 None] Extend volume completed successfully. Sep 01 01:16:06 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-42fa08e7-c48c-4133-9a87-124b0d4b28a3" returned: 0 in 0.282s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-42fa08e7-c48c-4133-9a87-124b0d4b28a3" released by "delete_volume" :: held 0.954s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created reservations ['bc6ffaed-fa60-45db-9246-2d5b76d74220', 'd9606bfb-f324-49a0-8bc3-6ed95aed0402', '28dda2eb-11a8-4ce4-9a0a-82c4e2b9acf2', '6b1b7b0e-568e-432e-8b26-ec9753229fb3'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:06 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:06 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Acquiring lock "cinder-b9b53ecc-1957-453a-a70a-58423e8a57f7-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Lock "cinder-b9b53ecc-1957-453a-a70a-58423e8a57f7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Acquiring lock "cinder-quobyte-b9b53ecc-1957-453a-a70a-58423e8a57f7" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Lock "cinder-quobyte-b9b53ecc-1957-453a-a70a-58423e8a57f7" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a91cdc-72c4-40cc-93f5-49a87d50bfd2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:06 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.306s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Deleted volume successfully. Sep 01 01:16:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b1dc9cc1-03cc-483b-887d-fa5b106b5aeb tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-42fa08e7-c48c-4133-9a87-124b0d4b28a3-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:07 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 Sep 01 01:16:07 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Acquiring lock "cinder-2cf711da-671a-4d8d-ba28-f645545cede1-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Lock "cinder-2cf711da-671a-4d8d-ba28-f645545cede1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Acquiring lock "cinder-quobyte-2cf711da-671a-4d8d-ba28-f645545cede1" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Lock "cinder-quobyte-2cf711da-671a-4d8d-ba28-f645545cede1" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[18794751-fd57-4026-8801-ab724a694bbe]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:07 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7" returned: 0 in 0.461s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:07 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7 Sep 01 01:16:07 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:07 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 Sep 01 01:16:07 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-cef9b25e-ac26-47af-96ca-0e6752445d8f-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-cef9b25e-ac26-47af-96ca-0e6752445d8f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-quobyte-cef9b25e-ac26-47af-96ca-0e6752445d8f" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-cef9b25e-ac26-47af-96ca-0e6752445d8f" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:07 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b9b53ecc-1957-453a-a70a-58423e8a57f7" returned: 0 in 0.471s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[feac5322-31a9-4c0a-87cb-042409e35954]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Lock "cinder-quobyte-b9b53ecc-1957-453a-a70a-58423e8a57f7" released by "delete_volume" :: held 1.001s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:07 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1" returned: 0 in 0.554s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:07 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1 Sep 01 01:16:07 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:16:07 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f Sep 01 01:16:07 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Flow 'volume_create_manager' (a7d9b288-34bb-4b0b-9d89-d555ce00aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f80ab01-ef35-4b99-a936-cdee343f349e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f80ab01-ef35-4b99-a936-cdee343f349e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1236588681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed684cbf3284449bb688e0aeb8ffcefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:08Z,use_quota=True,user_id='3d772add9b7640cdb53028a93691c66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c6ebb7-a66e-41f6-8942-5f6d61831308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c6ebb7-a66e-41f6-8942-5f6d61831308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e854c45-56ec-4563-bdc9-8966e4269e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e854c45-56ec-4563-bdc9-8966e4269e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9', 'volume_name': 'volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b1971d-8f56-4504-8aa1-4249cc1cd17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b1971d-8f56-4504-8aa1-4249cc1cd17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f3e76d-e843-4ee5-85ef-5684987854b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:08 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Volume a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9', 'volume_size': 1} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1236588681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed684cbf3284449bb688e0aeb8ffcefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:08Z,use_quota=True,user_id='3d772add9b7640cdb53028a93691c66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Creating volume a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:16:08 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Created reservations ['aca35398-8920-48d0-b2c3-182bc6de7f73', '461b1579-720b-4727-9211-3fa56252d4ac', '0d22edb1-2ee4-40b1-83b6-8f348564f599', 'd894b602-627b-439b-b438-8b69c6053eb7'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:08 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9 1073741824 Sep 01 01:16:08 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:08 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2cf711da-671a-4d8d-ba28-f645545cede1" returned: 0 in 0.331s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Lock "cinder-quobyte-2cf711da-671a-4d8d-ba28-f645545cede1" released by "delete_volume" :: held 0.960s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:08 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:08 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:08 devstack cinder-volume[87064]: WARNING cinder.quota [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:16:08 devstack cinder-volume[87064]: WARNING cinder.quota [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:16:08 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f" returned: 0 in 0.456s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Created reservations ['d86e2a83-f5b0-42ea-879a-46221bf49486', '67eb86e7-03ee-4466-9b3c-e146b317462f', '24ce3b4a-cf11-4bbb-9410-d3b264f2c37d', 'b47abc05-8d02-44e5-a8a0-f569f12f52f0'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:08 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f Sep 01 01:16:08 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:08 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:08 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:08 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cef9b25e-ac26-47af-96ca-0e6752445d8f" returned: 0 in 0.323s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:08 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.433s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-cef9b25e-ac26-47af-96ca-0e6752445d8f" released by "delete_volume" :: held 0.836s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:08 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Deleted volume successfully. Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c26415c9-526a-4e52-9ef7-1fcbd13765cf tempest-VolumesExtendTest-680086689 None] Lock "cinder-b9b53ecc-1957-453a-a70a-58423e8a57f7-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:08 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9 1073741824" returned: 0 in 0.658s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created reservations ['e9d7d13d-f11d-46c4-9a4e-5ec99aa76e92', 'ccfcc1a7-c166-4e03-8ae3-ad79d65ad5da', '26f955e2-66dc-48a0-a607-686c0df2e936', '1df7a8f1-b085-489a-817e-f025ed2010df'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:08 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.366s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:08 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Deleted volume successfully. Sep 01 01:16:08 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9 Sep 01 01:16:08 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-864f464a-3cff-4ddf-8d20-51032f709f18 tempest-VolumeAndVolumeTypeFromImageTest-373450547 None] Lock "cinder-2cf711da-671a-4d8d-ba28-f645545cede1-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-78339df3-7571-4549-8d39-0173b7669615-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:08 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:08 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-78339df3-7571-4549-8d39-0173b7669615-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-quobyte-279bed83-a236-461d-b9e5-18addeabce34" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-279bed83-a236-461d-b9e5-18addeabce34" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-quobyte-78339df3-7571-4549-8d39-0173b7669615" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-78339df3-7571-4549-8d39-0173b7669615" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Deleting offline snapshot 78339df3-7571-4549-8d39-0173b7669615 of volume 279bed83-a236-461d-b9e5-18addeabce34 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] snapshot_file for this snap is: volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[44612826-0a8a-4cd6-acb0-5552276f0771]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:09 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9" returned: 0 in 0.352s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f3e76d-e843-4ee5-85ef-5684987854b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7ada78-d9d8-4c83-a8b5-9ae8bc990a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:09 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Volume volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9 (a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9): created successfully Sep 01 01:16:09 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 Sep 01 01:16:09 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7ada78-d9d8-4c83-a8b5-9ae8bc990a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Flow 'volume_create_manager' (a7d9b288-34bb-4b0b-9d89-d555ce00aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:09 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8163f31c-6637-4d0e-a45d-fae1b35f73fd tempest-VolumesNegativeTest-1963197353 None] Created volume successfully. Sep 01 01:16:09 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.399s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:09 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Deleted volume successfully. Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f4b905c4-d3d5-4e2f-8a75-65f3c203783d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-cef9b25e-ac26-47af-96ca-0e6752445d8f-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:09 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615" returned: 0 in 0.437s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279bed83-a236-461d-b9e5-18addeabce34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea14ae7-2d7e-479f-8820-e32f6f2d5d38]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:09 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 Sep 01 01:16:09 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Flow 'volume_create_manager' (d4a9a00a-0096-4ac8-ad88-e760dc0e4196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca760f1-07dc-472c-a2bd-58a8eb37603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca760f1-07dc-472c-a2bd-58a8eb37603d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-354722230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46586d2-f115-4f03-bd1c-117c54efafbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28d3421b71944d6d9144391413b5c2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:10Z,use_quota=True,user_id='a9ff287994b54a928f443aa9dc05225f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301cb9bc-dc4a-47e3-b9ce-ce03f0e6eb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301cb9bc-dc4a-47e3-b9ce-ce03f0e6eb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29d9632-7b95-431f-83e8-f11c1c0c6849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29d9632-7b95-431f-83e8-f11c1c0c6849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd46586d2-f115-4f03-bd1c-117c54efafbc', 'volume_name': 'volume-d46586d2-f115-4f03-bd1c-117c54efafbc', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560b323e-4e18-44dd-86dd-92bbfe0cbbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560b323e-4e18-44dd-86dd-92bbfe0cbbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d606452c-a623-4e18-b382-0a94a569a1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:09 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Volume d46586d2-f115-4f03-bd1c-117c54efafbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d46586d2-f115-4f03-bd1c-117c54efafbc', 'volume_size': 1} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-354722230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46586d2-f115-4f03-bd1c-117c54efafbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28d3421b71944d6d9144391413b5c2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:10Z,use_quota=True,user_id='a9ff287994b54a928f443aa9dc05225f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Creating volume d46586d2-f115-4f03-bd1c-117c54efafbc {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:16:09 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:16:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:09 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc 1073741824 Sep 01 01:16:09 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:10 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34" returned: 0 in 0.552s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:10 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 Sep 01 01:16:10 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:10 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc 1073741824" returned: 0 in 0.667s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:10 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615" returned: 0 in 0.519s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:10 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615 Sep 01 01:16:10 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:10 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc Sep 01 01:16:10 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:11 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34.78339df3-7571-4549-8d39-0173b7669615" returned: 0 in 0.432s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-78339df3-7571-4549-8d39-0173b7669615" released by "_delete_snapshot" :: held 2.121s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:11 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-279bed83-a236-461d-b9e5-18addeabce34" released by "delete_snapshot" :: held 2.164s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc" returned: 0 in 0.464s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d606452c-a623-4e18-b382-0a94a569a1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d46586d2-f115-4f03-bd1c-117c54efafbc', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29673f9e-fea6-4bbb-8fdd-a4e1977de9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:11 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Volume volume-d46586d2-f115-4f03-bd1c-117c54efafbc (d46586d2-f115-4f03-bd1c-117c54efafbc): created successfully Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29673f9e-fea6-4bbb-8fdd-a4e1977de9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Flow 'volume_create_manager' (d4a9a00a-0096-4ac8-ad88-e760dc0e4196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:11 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2be39b1d-c66a-4163-a58d-76fe58551634 tempest-VolumesExtendTest-680086689 None] Created volume successfully. Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created reservations ['2ede44a5-b4f0-4995-9d6d-0d39e95ef6d8', '240faec0-66b7-4d9a-9bf4-758f0dc8225d', '044ce235-9eb1-491f-8feb-b2bb84a84dd4', '23b53704-1840-4a62-bf89-15395bfa65b4'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:11 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Delete snapshot completed successfully. Sep 01 01:16:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-6fa988d6-c7f9-4b52-8e07-3e920c4397e7 tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-78339df3-7571-4549-8d39-0173b7669615-delete_snapshot" released by "delete_snapshot" :: held 2.424s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] Creating offline snapshot 1d55bcbc-a356-450c-a622-a536310efda4 of volume d46586d2-f115-4f03-bd1c-117c54efafbc {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8abb6c-6478-4797-b6b7-8386fb16fa47]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-279bed83-a236-461d-b9e5-18addeabce34-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:12 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc Sep 01 01:16:12 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-279bed83-a236-461d-b9e5-18addeabce34-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "cinder-quobyte-279bed83-a236-461d-b9e5-18addeabce34" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-279bed83-a236-461d-b9e5-18addeabce34" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a58f2cd-c1ef-48ad-bd8d-3372bd539d24]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:12 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 Sep 01 01:16:12 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:12 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc" returned: 0 in 0.580s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:12 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 1G Sep 01 01:16:12 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:13 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34" returned: 0 in 0.599s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:13 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34 Sep 01 01:16:13 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:13 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-279bed83-a236-461d-b9e5-18addeabce34" returned: 0 in 0.436s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-quobyte-279bed83-a236-461d-b9e5-18addeabce34" released by "delete_volume" :: held 1.184s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:13 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 1G" returned: 0 in 0.945s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46586d2-f115-4f03-bd1c-117c54efafbc -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:13 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46586d2-f115-4f03-bd1c-117c54efafbc -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 Sep 01 01:16:13 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Created reservations ['c47bc305-5d6c-4ccf-80a4-62c064bbf2a3', '465406fd-c3ba-4785-a88b-e0a4f73ac5c9', 'f856f847-582a-4ce4-84fb-d5345d1b83c3', '0e4150a0-fcf3-447d-a710-7d60d9f90507'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:14 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:14 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:14 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46586d2-f115-4f03-bd1c-117c54efafbc -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4" returned: 0 in 0.564s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:14 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 is being set with open permissions: ugo+rw Sep 01 01:16:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:14 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 Sep 01 01:16:14 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:14 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.372s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:14 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:14 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Deleted volume successfully. Sep 01 01:16:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ad7fbd83-09e5-46bd-bec8-7d775b37e37d tempest-CreateVolumesFromSnapshotTest-1476995496 None] Lock "cinder-279bed83-a236-461d-b9e5-18addeabce34-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:14 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4" returned: 0 in 0.408s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:14 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=153,cinder:UPDATE=208,cinder:INSERT=71,cinder:DELETE=15 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:16:14 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:INSERT=58,cinder:SELECT=158,cinder:UPDATE=195,cinder:DELETE=19 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:16:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:14 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.info Sep 01 01:16:14 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:15 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.info" returned: 0 in 0.488s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:15 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.info is being set with open permissions: ugo+rw Sep 01 01:16:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:15 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.info Sep 01 01:16:15 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:15 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.info" returned: 0 in 0.436s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.597s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-84862a28-675e-45fb-961c-a9bc896a1f49 tempest-VolumesExtendTest-680086689 None] Create snapshot completed successfully Sep 01 01:16:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8ee657eb-71b8-419f-9eee-aa8a997fc768 tempest-VolumesExtendTest-680086689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8ee657eb-71b8-419f-9eee-aa8a997fc768 tempest-VolumesExtendTest-680086689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:16 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43b060d-aa30-4c5c-b89a-36eca3d5555e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8ee657eb-71b8-419f-9eee-aa8a997fc768 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:16 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc Sep 01 01:16:16 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:17 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8ee657eb-71b8-419f-9eee-aa8a997fc768 tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc" returned: 0 in 0.667s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8ee657eb-71b8-419f-9eee-aa8a997fc768 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 2G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8ee657eb-71b8-419f-9eee-aa8a997fc768 tempest-VolumesExtendTest-680086689 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 2G" returned: 0 in 0.236s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8ee657eb-71b8-419f-9eee-aa8a997fc768 tempest-VolumesExtendTest-680086689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.986s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:17 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8ee657eb-71b8-419f-9eee-aa8a997fc768 tempest-VolumesExtendTest-680086689 None] Extend volume completed successfully. Sep 01 01:16:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Acquiring lock "cinder-1d55bcbc-a356-450c-a622-a536310efda4-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Lock "cinder-1d55bcbc-a356-450c-a622-a536310efda4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Acquiring lock "cinder-quobyte-d46586d2-f115-4f03-bd1c-117c54efafbc" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Lock "cinder-quobyte-d46586d2-f115-4f03-bd1c-117c54efafbc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Acquiring lock "cinder-quobyte-1d55bcbc-a356-450c-a622-a536310efda4" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Lock "cinder-quobyte-1d55bcbc-a356-450c-a622-a536310efda4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Deleting offline snapshot 1d55bcbc-a356-450c-a622-a536310efda4 of volume d46586d2-f115-4f03-bd1c-117c54efafbc {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:16:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] snapshot_file for this snap is: volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:16:18 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b5c8a4-7695-44e9-8131-860dc015eddd]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:18 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 Sep 01 01:16:18 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:19 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4" returned: 0 in 1.085s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46586d2-f115-4f03-bd1c-117c54efafbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46cdd9e-0bac-4e5c-97f9-84114cda2ded]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:19 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc Sep 01 01:16:19 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Flow 'volume_create_manager' (c3bbea53-25c8-4a4d-b26d-23e774a41c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf994b68-6e87-46fe-8abd-5458bf2ba8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf994b68-6e87-46fe-8abd-5458bf2ba8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-816802174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0255cde41f72466ca3f70936adf57664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:20Z,use_quota=True,user_id='1016beb21344443bb166d34e4a4fcd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab7080a-e053-4dd9-b6c6-ce5267d2fa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab7080a-e053-4dd9-b6c6-ce5267d2fa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f428b5b-48e8-4f30-9df6-16a65318e052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f428b5b-48e8-4f30-9df6-16a65318e052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed', 'volume_name': 'volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8019d059-f107-49e9-a2a2-7508a9596f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8019d059-f107-49e9-a2a2-7508a9596f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462bc52b-89a3-4756-affe-d31874aa5f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:19 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Volume df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed', 'volume_size': 1} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-816802174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0255cde41f72466ca3f70936adf57664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:20Z,use_quota=True,user_id='1016beb21344443bb166d34e4a4fcd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Creating volume df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:16:19 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:16:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:20 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed 1073741824 Sep 01 01:16:20 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:20 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc" returned: 0 in 0.848s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:20 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 Sep 01 01:16:20 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:20 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed 1073741824" returned: 0 in 0.953s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:21 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed Sep 01 01:16:21 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:21 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4" returned: 0 in 0.869s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:21 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4 Sep 01 01:16:21 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:21 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed" returned: 0 in 0.418s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462bc52b-89a3-4756-affe-d31874aa5f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0275900-db6e-4e91-b179-21842341a289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:21 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Volume volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed (df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed): created successfully Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0275900-db6e-4e91-b179-21842341a289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Flow 'volume_create_manager' (c3bbea53-25c8-4a4d-b26d-23e774a41c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-abe45237-30c7-4c8f-af4b-e0678cd5b29b tempest-ProjectReaderTests-1759658979 None] Created volume successfully. Sep 01 01:16:21 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc.1d55bcbc-a356-450c-a622-a536310efda4" returned: 0 in 0.568s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Lock "cinder-quobyte-1d55bcbc-a356-450c-a622-a536310efda4" released by "_delete_snapshot" :: held 3.665s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Lock "cinder-quobyte-d46586d2-f115-4f03-bd1c-117c54efafbc" released by "delete_snapshot" :: held 3.696s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:21 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Created reservations ['014b7b9b-33c7-4a06-bf27-b5ac23ac730f', 'c1fd0562-f11f-48f4-aa59-f2fc86205b24', 'cdb67fd0-fa5a-4fed-b969-00750764f4e5', '19ef9999-0f04-48a0-8139-1c207a45e4c0'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Delete snapshot completed successfully. Sep 01 01:16:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dd1cb24-81f8-49df-9779-e488f5403dd6 tempest-VolumesExtendTest-680086689 None] Lock "cinder-1d55bcbc-a356-450c-a622-a536310efda4-delete_snapshot" released by "delete_snapshot" :: held 3.964s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Acquiring lock "cinder-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Lock "cinder-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Acquiring lock "cinder-quobyte-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Lock "cinder-quobyte-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:22 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf01845-acd4-4f2d-933e-35f844610c53]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:22 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed Sep 01 01:16:22 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Acquiring lock "cinder-d46586d2-f115-4f03-bd1c-117c54efafbc-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Lock "cinder-d46586d2-f115-4f03-bd1c-117c54efafbc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Acquiring lock "cinder-quobyte-d46586d2-f115-4f03-bd1c-117c54efafbc" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Lock "cinder-quobyte-d46586d2-f115-4f03-bd1c-117c54efafbc" acquired by "delete_volume" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:23 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[300982d5-cf4e-4ee3-82a9-ad66e47bb1db]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:23 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed" returned: 0 in 0.779s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:23 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed Sep 01 01:16:23 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:23 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc Sep 01 01:16:23 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:23 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed" returned: 0 in 0.553s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Lock "cinder-quobyte-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed" released by "delete_volume" :: held 1.402s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:23 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Created reservations ['0c75e77b-2958-42bb-9528-9b227b88f6c7', 'dc16ae1e-2e1c-4998-a1d3-695d0fecd33c', '84bb5d17-8c1b-4cb8-a3fa-2eae79e175c5', '7fd71a3d-4fa0-48ae-9791-b05f7e82e285'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:23 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc" returned: 0 in 0.873s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:24 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc Sep 01 01:16:24 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:24 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:24 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:24 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d46586d2-f115-4f03-bd1c-117c54efafbc" returned: 0 in 0.467s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Lock "cinder-quobyte-d46586d2-f115-4f03-bd1c-117c54efafbc" released by "delete_volume" :: held 1.504s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:24 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.392s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:24 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Deleted volume successfully. Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5b2084b4-ab6e-4c04-b3b8-4ab0d861e67b tempest-ProjectReaderTests-1759658979 None] Lock "cinder-df9f4ac2-0b4a-4395-84e4-3ed2bdaa4eed-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Created reservations ['3076f677-9f3e-4aef-a4cc-2aec663c7313', '72f63c7c-dd96-4ae6-9996-679efd019db4', '6def5105-4468-4eac-b467-fc2d5f16a7c0', '1f5dd4c1-c522-488a-aac1-856f9037e15c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:24 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:24 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:25 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.609s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:25 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Deleted volume successfully. Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3aa55670-8db5-4bb2-9b58-4a2869400539 tempest-VolumesExtendTest-680086689 None] Lock "cinder-d46586d2-f115-4f03-bd1c-117c54efafbc-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Flow 'volume_create_manager' (dc35cbb7-345a-4ded-9813-6dc38d394f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1577a25-a2cb-4687-8eba-c7c0bbdff3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1577a25-a2cb-4687-8eba-c7c0bbdff3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1016452784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31324bbb-e856-4546-b742-0aa3002e2d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0255cde41f72466ca3f70936adf57664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:25Z,use_quota=True,user_id='1016beb21344443bb166d34e4a4fcd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe6ba34-a30d-439e-b578-96b2385a8518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe6ba34-a30d-439e-b578-96b2385a8518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb355453-408d-4322-a8e1-d085eff8c4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb355453-408d-4322-a8e1-d085eff8c4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31324bbb-e856-4546-b742-0aa3002e2d27', 'volume_name': 'volume-31324bbb-e856-4546-b742-0aa3002e2d27', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6492043-87d2-4500-a36d-ce8707431fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6492043-87d2-4500-a36d-ce8707431fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ae865e-8990-43ac-9f93-8940980fbd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:25 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Volume 31324bbb-e856-4546-b742-0aa3002e2d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31324bbb-e856-4546-b742-0aa3002e2d27', 'volume_size': 1} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1016452784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31324bbb-e856-4546-b742-0aa3002e2d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0255cde41f72466ca3f70936adf57664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:25Z,use_quota=True,user_id='1016beb21344443bb166d34e4a4fcd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Creating volume 31324bbb-e856-4546-b742-0aa3002e2d27 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:16:25 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:16:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:25 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27 1073741824 Sep 01 01:16:25 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:26 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27 1073741824" returned: 0 in 0.765s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:26 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27 Sep 01 01:16:26 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:26 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27" returned: 0 in 0.302s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:16:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ae865e-8990-43ac-9f93-8940980fbd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31324bbb-e856-4546-b742-0aa3002e2d27', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5674f789-d0d3-4f40-962d-8dfd90b3a19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:26 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Volume volume-31324bbb-e856-4546-b742-0aa3002e2d27 (31324bbb-e856-4546-b742-0aa3002e2d27): created successfully Sep 01 01:16:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5674f789-d0d3-4f40-962d-8dfd90b3a19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Flow 'volume_create_manager' (dc35cbb7-345a-4ded-9813-6dc38d394f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:27 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6bd909ab-acaf-4d71-b6ea-0c287d9b1cf3 tempest-ProjectReaderTests-1759658979 None] Created volume successfully. Sep 01 01:16:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Acquiring lock "cinder-31324bbb-e856-4546-b742-0aa3002e2d27-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Lock "cinder-31324bbb-e856-4546-b742-0aa3002e2d27-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Acquiring lock "cinder-quobyte-31324bbb-e856-4546-b742-0aa3002e2d27" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Lock "cinder-quobyte-31324bbb-e856-4546-b742-0aa3002e2d27" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:27 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3548d445-4f5e-42d8-8c1b-8e6bfe54d08c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:28 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27 Sep 01 01:16:28 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:28 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27" returned: 0 in 0.436s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:28 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27 Sep 01 01:16:28 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:28 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-31324bbb-e856-4546-b742-0aa3002e2d27" returned: 0 in 0.342s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Lock "cinder-quobyte-31324bbb-e856-4546-b742-0aa3002e2d27" released by "delete_volume" :: held 0.827s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:28 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Created reservations ['40a1ca1c-ff04-46e4-9774-3beaf73a6c1d', '2176e63f-1be2-4c20-a96e-e250eea57156', '5c9518b3-2515-4493-8f66-6907352a6d71', 'f3951545-1e48-4901-b9fa-9c674ae3c15e'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:28 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:28 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:29 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.289s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:29 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:29 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Deleted volume successfully. Sep 01 01:16:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca39f661-a1f8-4105-9ccc-12524b74a561 tempest-ProjectReaderTests-1759658979 None] Lock "cinder-31324bbb-e856-4546-b742-0aa3002e2d27-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Flow 'volume_create_manager' (4438a9b0-3ab0-43b2-ade8-1832216fd9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ab3096-576a-471c-9d03-6ca1506e2ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ab3096-576a-471c-9d03-6ca1506e2ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-92577141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbaee97-aa3e-45e0-ac09-88886cc36a02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c61d5c7fc2a4836a282ccb268998d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:31Z,use_quota=True,user_id='6db1438dba1a404ea6e178c0d2036f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f4e554-ac69-42fb-98f1-83c56c85215b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f4e554-ac69-42fb-98f1-83c56c85215b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9397d453-e4c9-46b9-bf1f-252cb6e315ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9397d453-e4c9-46b9-bf1f-252cb6e315ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dbaee97-aa3e-45e0-ac09-88886cc36a02', 'volume_name': 'volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a8f4cc-5a27-483d-b424-765caf552d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a8f4cc-5a27-483d-b424-765caf552d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ada1754-66ab-4cef-9ce2-121cc07b5f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Volume 9dbaee97-aa3e-45e0-ac09-88886cc36a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02', 'volume_size': 1} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-92577141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbaee97-aa3e-45e0-ac09-88886cc36a02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c61d5c7fc2a4836a282ccb268998d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:31Z,use_quota=True,user_id='6db1438dba1a404ea6e178c0d2036f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Creating volume 9dbaee97-aa3e-45e0-ac09-88886cc36a02 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:16:30 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:16:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:30 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02 1073741824 Sep 01 01:16:30 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:31 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02 1073741824" returned: 0 in 0.695s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:31 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02 Sep 01 01:16:31 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:31 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02" returned: 0 in 0.350s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:16:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ada1754-66ab-4cef-9ce2-121cc07b5f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3623fa5e-0fc7-4a9c-bd81-0dd0d2252f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:32 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Volume volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02 (9dbaee97-aa3e-45e0-ac09-88886cc36a02): created successfully Sep 01 01:16:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3623fa5e-0fc7-4a9c-bd81-0dd0d2252f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Flow 'volume_create_manager' (4438a9b0-3ab0-43b2-ade8-1832216fd9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-241b6c2b-9cf6-4432-9413-e595e664eebf tempest-VolumesListTestJSON-1920769980 None] Created volume successfully. Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Flow 'volume_create_manager' (3374d6e0-6457-48f6-9afc-8fc6352af8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff665bd8-52c9-453c-be20-eaf0f1e75b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff665bd8-52c9-453c-be20-eaf0f1e75b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-52987390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53557889-4303-4423-8487-633e96ea6e3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c61d5c7fc2a4836a282ccb268998d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:34Z,use_quota=True,user_id='6db1438dba1a404ea6e178c0d2036f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c282e475-8dea-4372-aeb2-f643cf2bac59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c282e475-8dea-4372-aeb2-f643cf2bac59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869b03b9-d46a-4ddb-ad5f-fce8c6f7d49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869b03b9-d46a-4ddb-ad5f-fce8c6f7d49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53557889-4303-4423-8487-633e96ea6e3d', 'volume_name': 'volume-53557889-4303-4423-8487-633e96ea6e3d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac45305a-7adb-48a7-8b62-c29e6a6fd01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac45305a-7adb-48a7-8b62-c29e6a6fd01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2442feb8-14e7-4f2b-8b90-4cd85586e253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:33 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Volume 53557889-4303-4423-8487-633e96ea6e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53557889-4303-4423-8487-633e96ea6e3d', 'volume_size': 1} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-52987390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53557889-4303-4423-8487-633e96ea6e3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c61d5c7fc2a4836a282ccb268998d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:34Z,use_quota=True,user_id='6db1438dba1a404ea6e178c0d2036f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Creating volume 53557889-4303-4423-8487-633e96ea6e3d {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:16:33 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:16:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:33 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d 1073741824 Sep 01 01:16:33 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:34 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d 1073741824" returned: 0 in 0.612s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:34 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d Sep 01 01:16:34 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:34 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d" returned: 0 in 0.323s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:16:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2442feb8-14e7-4f2b-8b90-4cd85586e253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53557889-4303-4423-8487-633e96ea6e3d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537e1b4a-e84d-43a7-9758-95f41c826b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:34 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Volume volume-53557889-4303-4423-8487-633e96ea6e3d (53557889-4303-4423-8487-633e96ea6e3d): created successfully Sep 01 01:16:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537e1b4a-e84d-43a7-9758-95f41c826b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Flow 'volume_create_manager' (3374d6e0-6457-48f6-9afc-8fc6352af8a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0f183130-4457-4587-96ee-887ff078af99 tempest-VolumesListTestJSON-1920769980 None] Created volume successfully. Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Flow 'volume_create_manager' (ef6dbaa1-d010-401a-8a5d-050d74a7c09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8781c58d-cd52-489c-8997-bb27f65250ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8781c58d-cd52-489c-8997-bb27f65250ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1747514588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4300967e-599e-4454-b028-141eb37c3c06,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c61d5c7fc2a4836a282ccb268998d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:36Z,use_quota=True,user_id='6db1438dba1a404ea6e178c0d2036f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf09f3f-03f3-4bf5-b6d3-e06324b90fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf09f3f-03f3-4bf5-b6d3-e06324b90fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ac0026-7de9-4bea-b822-6f17c977ba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ac0026-7de9-4bea-b822-6f17c977ba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4300967e-599e-4454-b028-141eb37c3c06', 'volume_name': 'volume-4300967e-599e-4454-b028-141eb37c3c06', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cf9e0d-8fa3-4d34-b444-55691d8c9c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cf9e0d-8fa3-4d34-b444-55691d8c9c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5862c3d3-b274-4e91-8aed-61a4f5520c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:36 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Volume 4300967e-599e-4454-b028-141eb37c3c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4300967e-599e-4454-b028-141eb37c3c06', 'volume_size': 1} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1747514588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4300967e-599e-4454-b028-141eb37c3c06,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c61d5c7fc2a4836a282ccb268998d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:36Z,use_quota=True,user_id='6db1438dba1a404ea6e178c0d2036f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Creating volume 4300967e-599e-4454-b028-141eb37c3c06 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:16:36 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:16:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:36 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06 1073741824 Sep 01 01:16:36 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:37 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06 1073741824" returned: 0 in 0.688s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:37 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06 Sep 01 01:16:37 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:37 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06" returned: 0 in 0.320s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:37 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:16:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5862c3d3-b274-4e91-8aed-61a4f5520c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4300967e-599e-4454-b028-141eb37c3c06', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583940f8-6af4-43dc-94c0-792334e6bc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:37 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Volume volume-4300967e-599e-4454-b028-141eb37c3c06 (4300967e-599e-4454-b028-141eb37c3c06): created successfully Sep 01 01:16:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583940f8-6af4-43dc-94c0-792334e6bc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Flow 'volume_create_manager' (ef6dbaa1-d010-401a-8a5d-050d74a7c09c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:37 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-abaae780-73cf-40c9-83eb-18f84b4c0f38 tempest-VolumesListTestJSON-1920769980 None] Created volume successfully. Sep 01 01:16:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Acquiring lock "cinder-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Lock "cinder-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Acquiring lock "cinder-quobyte-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Lock "cinder-quobyte-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04756d7-5e82-4209-8de2-260e2bfef3bb]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:38 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9 Sep 01 01:16:38 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:38 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9" returned: 0 in 0.662s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:39 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9 Sep 01 01:16:39 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:39 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9" returned: 0 in 0.429s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Lock "cinder-quobyte-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9" released by "delete_volume" :: held 1.165s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:39 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Created reservations ['706f56bc-2201-4440-a656-3241e352ea1e', '0052ea76-2019-45ee-8624-96b20aa3a56c', '0dcc2953-36f0-46d3-8965-8fa0b1c7c160', 'e3e37aaf-5bc6-463b-88bf-5a65ed8528ad'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:39 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:39 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:40 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.321s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:40 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:40 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Deleted volume successfully. Sep 01 01:16:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cf75d98b-3fa8-4708-a24e-c1180b28d37b tempest-VolumesNegativeTest-1963197353 None] Lock "cinder-a3f6b5aa-de80-4e8f-8e18-cba5a2f01ff9-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "cinder-4300967e-599e-4454-b028-141eb37c3c06-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-4300967e-599e-4454-b028-141eb37c3c06-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "cinder-quobyte-4300967e-599e-4454-b028-141eb37c3c06" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-quobyte-4300967e-599e-4454-b028-141eb37c3c06" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:41 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ea3e82-563c-4efe-9187-7999e5675c64]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:41 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06 Sep 01 01:16:41 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:42 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06" returned: 0 in 0.488s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:42 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06 Sep 01 01:16:42 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:42 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4300967e-599e-4454-b028-141eb37c3c06" returned: 0 in 0.366s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-quobyte-4300967e-599e-4454-b028-141eb37c3c06" released by "delete_volume" :: held 0.941s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:42 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Created reservations ['c4ea4a4b-fcda-4d74-870d-5cc6c0cd92c7', '02e129f3-f9bd-4e5e-a9ca-fe3bb1dc4cac', 'e26196a0-0537-43ad-b8a1-f220797cd10f', '59b5139a-8641-4f3b-aa27-5340aa93adc1'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:42 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:42 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:43 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.341s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:43 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:43 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Deleted volume successfully. Sep 01 01:16:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9369873d-fa6d-41d9-9980-f5b15020417a tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-4300967e-599e-4454-b028-141eb37c3c06-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "cinder-53557889-4303-4423-8487-633e96ea6e3d-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:43 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-53557889-4303-4423-8487-633e96ea6e3d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "cinder-quobyte-53557889-4303-4423-8487-633e96ea6e3d" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-quobyte-53557889-4303-4423-8487-633e96ea6e3d" acquired by "delete_volume" :: waited 0.029s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbee9e5-9a31-48cb-81e6-526f03a13ba5]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:44 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d Sep 01 01:16:44 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:44 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d" returned: 0 in 0.586s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:44 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d Sep 01 01:16:44 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Flow 'volume_create_manager' (2b39e1b1-7685-4790-9134-4414e0c40a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678c59bf-6b51-4359-bdb8-d7fc7457af5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678c59bf-6b51-4359-bdb8-d7fc7457af5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-857680993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100b7915-3b74-49d2-8398-af388aeea7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cdfdf734c474402aa63c2b477dd3f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:45Z,use_quota=True,user_id='f8163e77d1dd478ab73fb76993527172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1947bda2-762e-4d50-a73a-fd33678fe1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1947bda2-762e-4d50-a73a-fd33678fe1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285d80c9-ee1c-41b8-9a47-17eefbf35037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285d80c9-ee1c-41b8-9a47-17eefbf35037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100b7915-3b74-49d2-8398-af388aeea7a4', 'volume_name': 'volume-100b7915-3b74-49d2-8398-af388aeea7a4', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1533a5b6-c309-416a-aa4b-1af17adad308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1533a5b6-c309-416a-aa4b-1af17adad308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28391c6-8935-4edb-9d5c-3a88f6bbd773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:44 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Volume 100b7915-3b74-49d2-8398-af388aeea7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100b7915-3b74-49d2-8398-af388aeea7a4', 'volume_size': 1} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-857680993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100b7915-3b74-49d2-8398-af388aeea7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cdfdf734c474402aa63c2b477dd3f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:45Z,use_quota=True,user_id='f8163e77d1dd478ab73fb76993527172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Creating volume 100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:16:44 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:44 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 1073741824 Sep 01 01:16:44 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:44 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-53557889-4303-4423-8487-633e96ea6e3d" returned: 0 in 0.312s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-quobyte-53557889-4303-4423-8487-633e96ea6e3d" released by "delete_volume" :: held 0.962s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Created reservations ['d1add85a-a2da-4fb1-8bb1-612d7f43e2f3', '8641fc4b-fbe6-402c-8b03-cb6152999baf', '0005d372-a108-4ece-b41d-733f8b1d5dc7', '9556a26c-bb3a-4ab0-b170-20808846b12b'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:45 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:45 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:45 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 1073741824" returned: 0 in 0.627s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:45 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.375s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Deleted volume successfully. Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df704e58-7fb9-47b1-9a87-b5bd32130bcc tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-53557889-4303-4423-8487-633e96ea6e3d-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:45 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 Sep 01 01:16:45 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:46 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4" returned: 0 in 0.294s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28391c6-8935-4edb-9d5c-3a88f6bbd773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100b7915-3b74-49d2-8398-af388aeea7a4', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df21b27-ce10-4701-87fc-d35dec80dd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:46 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Volume volume-100b7915-3b74-49d2-8398-af388aeea7a4 (100b7915-3b74-49d2-8398-af388aeea7a4): created successfully Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df21b27-ce10-4701-87fc-d35dec80dd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Flow 'volume_create_manager' (2b39e1b1-7685-4790-9134-4414e0c40a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:46 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c4ca3970-7d02-427e-b8ac-18d586442497 tempest-VolumesSnapshotListTestJSON-1846596032 None] Created volume successfully. Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "cinder-9dbaee97-aa3e-45e0-ac09-88886cc36a02-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-9dbaee97-aa3e-45e0-ac09-88886cc36a02-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "cinder-quobyte-9dbaee97-aa3e-45e0-ac09-88886cc36a02" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-quobyte-9dbaee97-aa3e-45e0-ac09-88886cc36a02" acquired by "delete_volume" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7949862-24bd-4b49-9ab6-8d6c13c35c97]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:46 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02 Sep 01 01:16:46 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:46 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02" returned: 0 in 0.424s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:46 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02 Sep 01 01:16:46 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] Creating offline snapshot 381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 of volume 100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aa7344-b434-4b7a-9998-4aaa3ecb921c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:47 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9dbaee97-aa3e-45e0-ac09-88886cc36a02" returned: 0 in 0.319s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-quobyte-9dbaee97-aa3e-45e0-ac09-88886cc36a02" released by "delete_volume" :: held 0.797s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:47 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 Sep 01 01:16:47 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Created reservations ['ab581dad-11b2-449c-8852-c8b3c69aa62f', '77df0f67-75ea-435b-8c24-bdf32850053a', 'f8756347-5a0b-4d97-9078-af5e648b6f5a', '1d201cf6-1aa5-48c5-af28-cdcf744d5af6'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:47 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:47 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:47 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4" returned: 0 in 0.528s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:47 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 1G Sep 01 01:16:47 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:47 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.329s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:47 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Deleted volume successfully. Sep 01 01:16:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fba4e922-9e13-40c3-ac98-40ba1240887b tempest-VolumesListTestJSON-1920769980 None] Lock "cinder-9dbaee97-aa3e-45e0-ac09-88886cc36a02-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:16:48 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 1G" returned: 0 in 0.657s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100b7915-3b74-49d2-8398-af388aeea7a4 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:48 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100b7915-3b74-49d2-8398-af388aeea7a4 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 Sep 01 01:16:48 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:48 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100b7915-3b74-49d2-8398-af388aeea7a4 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1" returned: 0 in 0.308s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:48 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 is being set with open permissions: ugo+rw Sep 01 01:16:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:48 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 Sep 01 01:16:48 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:48 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1" returned: 0 in 0.341s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:49 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.info Sep 01 01:16:49 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:49 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.info" returned: 0 in 0.342s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:49 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.info is being set with open permissions: ugo+rw Sep 01 01:16:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:49 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.info Sep 01 01:16:49 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:49 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.info" returned: 0 in 0.348s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.633s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:49 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c4aec8a7-e773-4c43-98ea-dac2fa12c185 tempest-VolumesSnapshotListTestJSON-1846596032 None] Create snapshot completed successfully Sep 01 01:16:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] Creating offline snapshot d4538317-8904-478c-9fba-9f065bb104a3 of volume 100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:16:50 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01fb2d4-4615-4ff0-a72f-6623a2ff2f9f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:50 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 Sep 01 01:16:50 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:51 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1" returned: 0 in 0.475s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100b7915-3b74-49d2-8398-af388aeea7a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:16:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:51 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 1G Sep 01 01:16:51 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:51 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 1G" returned: 0 in 0.691s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:51 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 Sep 01 01:16:51 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:52 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3" returned: 0 in 0.468s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:52 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 is being set with open permissions: ugo+rw Sep 01 01:16:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:52 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 Sep 01 01:16:52 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:16:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:52 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:16:52 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:52 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3" returned: 0 in 0.407s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:52 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9b749401-688e-41ef-ad8b-3823d1bc71e6 tempest-VolumesSnapshotListTestJSON-1846596032 None] Create snapshot completed successfully Sep 01 01:16:53 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.411s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:16:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:16:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:16:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:16:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] Creating offline snapshot 4de31009-b22f-4688-9f3b-4b97d3d73502 of volume 100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:16:54 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a365af01-dc40-4dd8-8562-05a22cd08286]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:54 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 Sep 01 01:16:54 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:54 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3" returned: 0 in 0.549s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100b7915-3b74-49d2-8398-af388aeea7a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:16:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:54 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 1G Sep 01 01:16:54 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:55 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 1G" returned: 0 in 0.742s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:55 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 Sep 01 01:16:55 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Flow 'volume_create_manager' (9581f2f0-98a0-40ab-8455-b0f2c1fa1abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150a6fd3-ac17-40ca-8078-c2fb3f3fdc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150a6fd3-ac17-40ca-8078-c2fb3f3fdc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-796272661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f37d610-776d-44fc-ac1e-59f27cb816e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4c6c31be104f4eb941fd3cc6414087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:56Z,use_quota=True,user_id='62e1c68cff15495bb555d2c32c98f431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560196e4-5753-49dc-9ad7-194e4da871bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560196e4-5753-49dc-9ad7-194e4da871bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb1a4c3-7edc-4383-93ec-d53d8026c9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb1a4c3-7edc-4383-93ec-d53d8026c9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f37d610-776d-44fc-ac1e-59f27cb816e7', 'volume_name': 'volume-2f37d610-776d-44fc-ac1e-59f27cb816e7', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49926a96-ba07-425d-bf3c-456b0ab309fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49926a96-ba07-425d-bf3c-456b0ab309fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f128ffaa-be23-463b-a1bb-4c55f7108941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:55 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Volume 2f37d610-776d-44fc-ac1e-59f27cb816e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f37d610-776d-44fc-ac1e-59f27cb816e7', 'volume_size': 1} Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:55 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502" returned: 0 in 0.484s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:55 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 is being set with open permissions: ugo+rw Sep 01 01:16:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:55 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 Sep 01 01:16:55 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:56 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502" returned: 0 in 0.341s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.495s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-796272661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f37d610-776d-44fc-ac1e-59f27cb816e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4c6c31be104f4eb941fd3cc6414087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:16:56Z,use_quota=True,user_id='62e1c68cff15495bb555d2c32c98f431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Creating volume 2f37d610-776d-44fc-ac1e-59f27cb816e7 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:16:56 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:56 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 1073741824 Sep 01 01:16:56 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:56 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b7bf7d03-5bc2-4cfe-b77d-146a28e7c0f9 tempest-VolumesSnapshotListTestJSON-1846596032 None] Create snapshot completed successfully Sep 01 01:16:56 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 1073741824" returned: 0 in 0.495s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:56 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 Sep 01 01:16:56 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:57 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7" returned: 0 in 0.254s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:16:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:16:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f128ffaa-be23-463b-a1bb-4c55f7108941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f37d610-776d-44fc-ac1e-59f27cb816e7', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09046ca9-637c-40c6-bd9d-38572e94ee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:16:57 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Volume volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 (2f37d610-776d-44fc-ac1e-59f27cb816e7): created successfully Sep 01 01:16:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09046ca9-637c-40c6-bd9d-38572e94ee74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:16:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Flow 'volume_create_manager' (9581f2f0-98a0-40ab-8455-b0f2c1fa1abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:16:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8442f2c3-4f20-44e7-a628-68807bc79ad6 tempest-SnapshotDependencyTests-218267063 None] Created volume successfully. Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "cinder-4de31009-b22f-4688-9f3b-4b97d3d73502-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-4de31009-b22f-4688-9f3b-4b97d3d73502-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "cinder-quobyte-4de31009-b22f-4688-9f3b-4b97d3d73502" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-4de31009-b22f-4688-9f3b-4b97d3d73502" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Deleting offline snapshot 4de31009-b22f-4688-9f3b-4b97d3d73502 of volume 100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] snapshot_file for this snap is: volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] Creating offline snapshot fee63dee-edab-4cdf-9588-26c9d8228eeb of volume 2f37d610-776d-44fc-ac1e-59f27cb816e7 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ae0241-cc98-4361-b7d2-667893d2641e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7775d82c-22fb-4a27-ac59-8b5089ea32ad]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:58 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 Sep 01 01:16:58 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:58 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 Sep 01 01:16:58 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:58 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502" returned: 0 in 0.446s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100b7915-3b74-49d2-8398-af388aeea7a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c2e90e-1780-49ae-8b33-6d63f692dc21]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:58 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7" returned: 0 in 0.512s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:58 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb 1G Sep 01 01:16:58 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:58 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 Sep 01 01:16:58 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:59 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3" returned: 0 in 0.422s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100b7915-3b74-49d2-8398-af388aeea7a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:16:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:59 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 Sep 01 01:16:59 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:59 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb 1G" returned: 0 in 0.497s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:59 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb Sep 01 01:16:59 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:59 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb" returned: 0 in 0.356s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:59 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb is being set with open permissions: ugo+rw Sep 01 01:16:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:59 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb Sep 01 01:16:59 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:16:59 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 01 01:16:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502" returned: 0 in 0.653s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:16:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:16:59 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502 Sep 01 01:16:59 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:00 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb" returned: 0 in 0.422s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:00 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.info Sep 01 01:17:00 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:00 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.4de31009-b22f-4688-9f3b-4b97d3d73502" returned: 0 in 0.426s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-4de31009-b22f-4688-9f3b-4b97d3d73502" released by "_delete_snapshot" :: held 2.103s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" released by "delete_snapshot" :: held 2.149s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:00 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Created reservations ['0fc17012-0de8-43f8-89d2-f0ed962d0cab', '759bebfc-aef1-4017-9c92-e80914c30e54', '1c6fec04-fdf0-4988-ac9a-a633524d53ca', 'ed1fbb8d-1d7c-4100-ab3f-ab6e5d16a7ef'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:17:00 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.info" returned: 0 in 0.341s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:00 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.info is being set with open permissions: ugo+rw Sep 01 01:17:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:00 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.info Sep 01 01:17:00 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Delete snapshot completed successfully. Sep 01 01:17:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b181950-8ee3-4a09-9d2c-fd6ecb06745d tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-4de31009-b22f-4688-9f3b-4b97d3d73502-delete_snapshot" released by "delete_snapshot" :: held 2.478s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:00 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.info" returned: 0 in 0.290s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-24200e11-5852-4e39-8d7a-99eee849835b tempest-SnapshotDependencyTests-218267063 None] Create snapshot completed successfully Sep 01 01:17:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "cinder-d4538317-8904-478c-9fba-9f065bb104a3-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-d4538317-8904-478c-9fba-9f065bb104a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "cinder-quobyte-d4538317-8904-478c-9fba-9f065bb104a3" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-d4538317-8904-478c-9fba-9f065bb104a3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Deleting offline snapshot d4538317-8904-478c-9fba-9f065bb104a3 of volume 100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:17:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] snapshot_file for this snap is: volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:17:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c318a3c9-1a37-43e6-a45d-02d5fa572336]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:01 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 Sep 01 01:17:01 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:02 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3" returned: 0 in 0.567s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100b7915-3b74-49d2-8398-af388aeea7a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b2ec2b-b719-4a94-b8ac-39b69a219d07]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Flow 'volume_create_manager' (8ffdf1ad-b909-4b36-ad8c-a6403eb5859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db1b178-1925-4b38-9dab-45edd4129d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:02 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 Sep 01 01:17:02 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db1b178-1925-4b38-9dab-45edd4129d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df945c8-1f62-4807-9d7e-dca8f64a0430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4c6c31be104f4eb941fd3cc6414087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fee63dee-edab-4cdf-9588-26c9d8228eeb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:17:02Z,use_quota=True,user_id='62e1c68cff15495bb555d2c32c98f431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391b6320-5e3f-4ac2-80b9-234ea69d9b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391b6320-5e3f-4ac2-80b9-234ea69d9b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07ab1d2-a0ac-46b3-a9e4-686038c20b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07ab1d2-a0ac-46b3-a9e4-686038c20b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2df945c8-1f62-4807-9d7e-dca8f64a0430', 'volume_name': 'volume-2df945c8-1f62-4807-9d7e-dca8f64a0430', 'volume_size': 1, 'snapshot_id': 'fee63dee-edab-4cdf-9588-26c9d8228eeb'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8342f723-c3f5-45cb-a59d-c5c53dceb245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8342f723-c3f5-45cb-a59d-c5c53dceb245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43346cd2-c10c-49df-997f-b86a8d12abda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:02 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Volume 2df945c8-1f62-4807-9d7e-dca8f64a0430: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2df945c8-1f62-4807-9d7e-dca8f64a0430', 'volume_size': 1, 'snapshot_id': 'fee63dee-edab-4cdf-9588-26c9d8228eeb'} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "cinder-quobyte-fee63dee-edab-4cdf-9588-26c9d8228eeb-2df945c8-1f62-4807-9d7e-dca8f64a0430" by "_create_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-fee63dee-edab-4cdf-9588-26c9d8228eeb-2df945c8-1f62-4807-9d7e-dca8f64a0430" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Creating volume 2df945c8-1f62-4807-9d7e-dca8f64a0430 from snapshot fee63dee-edab-4cdf-9588-26c9d8228eeb {{(pid=87064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "cinder-quobyte-2df945c8-1f62-4807-9d7e-dca8f64a0430" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-2df945c8-1f62-4807-9d7e-dca8f64a0430" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] snapshot: fee63dee-edab-4cdf-9588-26c9d8228eeb, volume: 2df945c8-1f62-4807-9d7e-dca8f64a0430, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e840c18-2adb-4d31-8a55-8864e553cd17]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:02 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb Sep 01 01:17:02 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:02 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1" returned: 0 in 0.652s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100b7915-3b74-49d2-8398-af388aeea7a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:02 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 Sep 01 01:17:02 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:02 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb" returned: 0 in 0.493s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f37d610-776d-44fc-ac1e-59f27cb816e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d94261-4bab-4b51-9897-0ef2f48d5e04]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:03 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 Sep 01 01:17:03 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:03 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3" returned: 0 in 0.523s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:03 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3 Sep 01 01:17:03 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:03 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7" returned: 0 in 0.488s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:03 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 Sep 01 01:17:03 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:03 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.d4538317-8904-478c-9fba-9f065bb104a3" returned: 0 in 0.331s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-d4538317-8904-478c-9fba-9f065bb104a3" released by "_delete_snapshot" :: held 2.232s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" released by "delete_snapshot" :: held 2.256s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Created reservations ['efa69d19-559b-4c28-8b4b-4fab169dde68', '61d5fed4-5961-4279-917a-dd7d416994e4', '2ee8c2a1-da9f-4d9d-80ee-a744326b4c7b', '8cde08f2-cd97-42e8-a0de-b05eb2e14e96'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:17:03 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Delete snapshot completed successfully. Sep 01 01:17:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4eb7f586-c0be-4dc9-8736-f0bdd8b23adc tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-d4538317-8904-478c-9fba-9f065bb104a3-delete_snapshot" released by "delete_snapshot" :: held 2.463s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "cinder-381f33c9-570f-46bb-b8dc-ce08a8f8dfd1-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-381f33c9-570f-46bb-b8dc-ce08a8f8dfd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "cinder-quobyte-381f33c9-570f-46bb-b8dc-ce08a8f8dfd1" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-381f33c9-570f-46bb-b8dc-ce08a8f8dfd1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Deleting offline snapshot 381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 of volume 100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:17:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] snapshot_file for this snap is: volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:17:05 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea7e4e3-6f01-49e0-ae84-5201397e07ad]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:05 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 Sep 01 01:17:05 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:06 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1" returned: 0 in 1.098s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100b7915-3b74-49d2-8398-af388aeea7a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:17:06 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca9cd47-d0d3-4596-b2f1-f9728446a6b2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:06 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 Sep 01 01:17:06 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:07 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4" returned: 0 in 1.060s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:07 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 Sep 01 01:17:07 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:08 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1" returned: 0 in 0.848s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:08 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1 Sep 01 01:17:08 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:08 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4.381f33c9-570f-46bb-b8dc-ce08a8f8dfd1" returned: 0 in 0.774s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-381f33c9-570f-46bb-b8dc-ce08a8f8dfd1" released by "_delete_snapshot" :: held 4.137s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" released by "delete_snapshot" :: held 4.191s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:09 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Created reservations ['261b4719-1338-4e83-81f5-22627b3c0b3f', '24cb3af2-aaba-499c-88d7-eac6292cd6fa', '15083daf-d04b-483f-9188-58484b94c876', 'b268debe-a15e-4ad8-b629-ec86315d2437'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:17:09 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Delete snapshot completed successfully. Sep 01 01:17:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-95669621-7c05-4d7c-903b-2e94a7bf4056 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-381f33c9-570f-46bb-b8dc-ce08a8f8dfd1-delete_snapshot" released by "delete_snapshot" :: held 4.626s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:09 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430" returned: 0 in 6.085s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:09 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:17:09 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Converted 1024.00 MB image at 168.26 MB/s Sep 01 01:17:09 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 is being set with open permissions: ugo+rw Sep 01 01:17:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:09 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 Sep 01 01:17:09 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:09 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430" returned: 0 in 0.309s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-2df945c8-1f62-4807-9d7e-dca8f64a0430" released by "_copy_volume_from_snapshot" :: held 7.552s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-fee63dee-edab-4cdf-9588-26c9d8228eeb-2df945c8-1f62-4807-9d7e-dca8f64a0430" released by "_create_volume_from_snapshot" :: held 7.643s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.663s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43346cd2-c10c-49df-997f-b86a8d12abda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df945c8-1f62-4807-9d7e-dca8f64a0430', 'volume_size': 1, 'snapshot_id': 'fee63dee-edab-4cdf-9588-26c9d8228eeb'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fa83f2-3c0f-4d1d-8821-805c720485d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:10 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Volume volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 (2df945c8-1f62-4807-9d7e-dca8f64a0430): created successfully Sep 01 01:17:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fa83f2-3c0f-4d1d-8821-805c720485d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Flow 'volume_create_manager' (8ffdf1ad-b909-4b36-ad8c-a6403eb5859d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:17:10 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c8cbdad9-5b0a-4b42-94a2-e7326b535b60 tempest-SnapshotDependencyTests-218267063 None] Created volume successfully. Sep 01 01:17:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "cinder-100b7915-3b74-49d2-8398-af388aeea7a4-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-100b7915-3b74-49d2-8398-af388aeea7a4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:10 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e592e9c-d28a-459d-88bf-cf3fe91569b8]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:10 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 Sep 01 01:17:10 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:11 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4" returned: 0 in 0.469s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:11 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4 Sep 01 01:17:11 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "cinder-fee63dee-edab-4cdf-9588-26c9d8228eeb-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-fee63dee-edab-4cdf-9588-26c9d8228eeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "cinder-quobyte-2f37d610-776d-44fc-ac1e-59f27cb816e7" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-2f37d610-776d-44fc-ac1e-59f27cb816e7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "cinder-quobyte-fee63dee-edab-4cdf-9588-26c9d8228eeb" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-fee63dee-edab-4cdf-9588-26c9d8228eeb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Deleting offline snapshot fee63dee-edab-4cdf-9588-26c9d8228eeb of volume 2f37d610-776d-44fc-ac1e-59f27cb816e7 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] snapshot_file for this snap is: volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e1c814-075a-4545-9d93-022a3d3c12c5]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:11 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb Sep 01 01:17:11 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:11 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-100b7915-3b74-49d2-8398-af388aeea7a4" returned: 0 in 0.325s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-quobyte-100b7915-3b74-49d2-8398-af388aeea7a4" released by "delete_volume" :: held 0.892s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Created reservations ['f1e38243-8ede-4249-9aaa-e507c9cbe323', 'd48d3879-7041-4733-b91b-c46df920ed5f', '44332813-062d-4ed0-b64c-44acc1d2572c', 'bb64e2af-41d4-42c7-ab6c-ec3f30e79a70'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:17:11 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb" returned: 0 in 0.435s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f37d610-776d-44fc-ac1e-59f27cb816e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[36697aaf-28ac-4e89-84aa-95a2df2ac1eb]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:11 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 Sep 01 01:17:11 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:12 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:17:12 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:12 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.313s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:12 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:17:12 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Deleted volume successfully. Sep 01 01:17:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ce24cfd6-cfda-4d94-be9d-ade36be5a811 tempest-VolumesSnapshotListTestJSON-1846596032 None] Lock "cinder-100b7915-3b74-49d2-8398-af388aeea7a4-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:12 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7" returned: 0 in 0.702s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:12 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb Sep 01 01:17:12 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:12 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb" returned: 0 in 0.486s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:12 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb Sep 01 01:17:12 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:13 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7.fee63dee-edab-4cdf-9588-26c9d8228eeb" returned: 0 in 0.338s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-fee63dee-edab-4cdf-9588-26c9d8228eeb" released by "_delete_snapshot" :: held 2.112s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-2f37d610-776d-44fc-ac1e-59f27cb816e7" released by "delete_snapshot" :: held 2.144s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:13 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Created reservations ['5097f905-e22f-41fc-876f-e12ceab40245', 'eb54d3cc-2b8c-482c-8c06-c0b2b47605d9', '62923d1c-25e5-4d3b-9974-761322455c4f', '0aaf1ef1-f67e-4452-8fc3-2d102a8c3ad0'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:17:13 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Delete snapshot completed successfully. Sep 01 01:17:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8571c982-4f7c-4de9-b899-d1b0a750e539 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-fee63dee-edab-4cdf-9588-26c9d8228eeb-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "cinder-2f37d610-776d-44fc-ac1e-59f27cb816e7-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-2f37d610-776d-44fc-ac1e-59f27cb816e7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "cinder-quobyte-2f37d610-776d-44fc-ac1e-59f27cb816e7" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-2f37d610-776d-44fc-ac1e-59f27cb816e7" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:14 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7add2dd6-aabd-4f9c-a7ee-d684cb3a38a7]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:14 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 Sep 01 01:17:14 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:15 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7" returned: 0 in 0.449s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:15 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7 Sep 01 01:17:15 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:15 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2f37d610-776d-44fc-ac1e-59f27cb816e7" returned: 0 in 0.290s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-2f37d610-776d-44fc-ac1e-59f27cb816e7" released by "delete_volume" :: held 0.825s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=116,cinder:DELETE=12,cinder:SELECT=91,cinder:INSERT=32 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=109,cinder:UPDATE=133,cinder:INSERT=31,cinder:DELETE=9 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Created reservations ['48cdb294-c51f-4221-ab98-929fc11f8b75', '930f9f46-3eb2-483f-92d2-291a1c877dd5', 'dc94dcf7-ef35-48a8-b5c4-a33be7849a59', '5be7ecd4-6196-4fe2-941a-bea5fae37262'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:15 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:17:15 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "cinder-2df945c8-1f62-4807-9d7e-dca8f64a0430-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-2df945c8-1f62-4807-9d7e-dca8f64a0430-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "cinder-quobyte-2df945c8-1f62-4807-9d7e-dca8f64a0430" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-2df945c8-1f62-4807-9d7e-dca8f64a0430" acquired by "delete_volume" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba6200b-9677-45c1-b8cc-97715e1cd236]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:16 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.336s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:16 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:17:16 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Deleted volume successfully. Sep 01 01:17:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c476b5b7-f38b-479d-a2ef-643f63120413 tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-2f37d610-776d-44fc-ac1e-59f27cb816e7-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:16 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 Sep 01 01:17:16 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:16 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430" returned: 0 in 0.496s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:16 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430 Sep 01 01:17:16 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:16 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2df945c8-1f62-4807-9d7e-dca8f64a0430" returned: 0 in 0.327s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-quobyte-2df945c8-1f62-4807-9d7e-dca8f64a0430" released by "delete_volume" :: held 0.892s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:16 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Created reservations ['47c7c7ea-7cf5-47de-a307-f3e16d99b118', '4842712e-6a1b-4b71-891b-93488b47d535', 'f04b1b1d-11de-4705-8cb3-20961527163d', '67501ee6-4977-4670-9793-c9702db74322'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:17:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:17:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:17:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:17 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:17:17 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:17 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.294s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:17 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:17:17 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Deleted volume successfully. Sep 01 01:17:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-777fc15a-ec7c-475a-971b-f597238ed85b tempest-SnapshotDependencyTests-218267063 None] Lock "cinder-2df945c8-1f62-4807-9d7e-dca8f64a0430-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:17:27 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:INSERT=3,cinder:UPDATE=15,cinder:SELECT=4,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:17:27 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Flow 'volume_create_manager' (cb4651c8-28e8-49a3-ab3c-2a26722bc2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da04a715-f53f-497a-95e1-d71078f043ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da04a715-f53f-497a-95e1-d71078f043ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-945576982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571f066d-c9f1-4850-bbf7-21c608823124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80bf7eec580e46388a05b38ad9effb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:17:32Z,use_quota=True,user_id='550b794732ee4f038790dac1829cff85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d04d1e8-28fe-4a3a-97c6-70b82900d123),volume_type_id=6d04d1e8-28fe-4a3a-97c6-70b82900d123)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232fd2d8-7aab-4790-8c53-bb9288f21b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232fd2d8-7aab-4790-8c53-bb9288f21b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f66162-1d25-49e2-a171-fccae05b7533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f66162-1d25-49e2-a171-fccae05b7533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571f066d-c9f1-4850-bbf7-21c608823124', 'volume_name': 'volume-571f066d-c9f1-4850-bbf7-21c608823124', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c8aec8-bfdb-4026-acca-9236ec2b7ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c8aec8-bfdb-4026-acca-9236ec2b7ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709efdf8-3c1e-466f-90f8-042fa3340dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:31 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Volume 571f066d-c9f1-4850-bbf7-21c608823124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571f066d-c9f1-4850-bbf7-21c608823124', 'volume_size': 1} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-945576982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571f066d-c9f1-4850-bbf7-21c608823124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80bf7eec580e46388a05b38ad9effb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:17:32Z,use_quota=True,user_id='550b794732ee4f038790dac1829cff85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d04d1e8-28fe-4a3a-97c6-70b82900d123),volume_type_id=6d04d1e8-28fe-4a3a-97c6-70b82900d123)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Creating volume 571f066d-c9f1-4850-bbf7-21c608823124 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:17:31 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:17:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:31 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124 1073741824 Sep 01 01:17:31 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Flow 'volume_create_manager' (48646550-7c72-4241-894a-673dfae768e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c5706b-bbb7-4689-9bac-f59993adfe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c5706b-bbb7-4689-9bac-f59993adfe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1407221001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc7d6e8-5ff6-47ce-8186-cc97abec2697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80bf7eec580e46388a05b38ad9effb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:17:32Z,use_quota=True,user_id='550b794732ee4f038790dac1829cff85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a71656-947f-4866-93e3-2e0672cc2068),volume_type_id=21a71656-947f-4866-93e3-2e0672cc2068)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b73a51e-1670-4eb8-9053-d3ca32cf9b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b73a51e-1670-4eb8-9053-d3ca32cf9b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85271cc3-cc1f-4843-8499-c2e29fdb3dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85271cc3-cc1f-4843-8499-c2e29fdb3dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc7d6e8-5ff6-47ce-8186-cc97abec2697', 'volume_name': 'volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d7b591-9951-4a9e-8ea8-1de99da8864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d7b591-9951-4a9e-8ea8-1de99da8864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf040130-3b30-4cc8-a72a-bd8cc929f255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:32 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Volume bdc7d6e8-5ff6-47ce-8186-cc97abec2697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697', 'volume_size': 1} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:32 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124 1073741824" returned: 0 in 0.702s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:32 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124 Sep 01 01:17:32 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Flow 'volume_create_manager' (148142ca-e92e-4b0d-b80e-012b1b46e6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b37168e-d57e-4a1b-aa79-fbd5d93c47cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:33 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124" returned: 0 in 0.517s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1407221001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc7d6e8-5ff6-47ce-8186-cc97abec2697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80bf7eec580e46388a05b38ad9effb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:17:32Z,use_quota=True,user_id='550b794732ee4f038790dac1829cff85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a71656-947f-4866-93e3-2e0672cc2068),volume_type_id=21a71656-947f-4866-93e3-2e0672cc2068)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Creating volume bdc7d6e8-5ff6-47ce-8186-cc97abec2697 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:17:33 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b37168e-d57e-4a1b-aa79-fbd5d93c47cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1709507000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee21e694-ea66-4058-882e-f6d437fa8a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80bf7eec580e46388a05b38ad9effb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:17:33Z,use_quota=True,user_id='550b794732ee4f038790dac1829cff85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4abff66e-8ff4-488e-86eb-22988bfc0b8e),volume_type_id=4abff66e-8ff4-488e-86eb-22988bfc0b8e)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:33 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697 1073741824 Sep 01 01:17:33 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f583231-5a8c-4b2a-af65-e955814e4c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f583231-5a8c-4b2a-af65-e955814e4c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089ad459-a740-4231-96fc-115986e59d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.image.glance [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Creating Keystone auth plugin from conf {{(pid=87064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709efdf8-3c1e-466f-90f8-042fa3340dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571f066d-c9f1-4850-bbf7-21c608823124', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f864bf9d-5247-4a44-ad56-30dd743e0cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:33 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Volume volume-571f066d-c9f1-4850-bbf7-21c608823124 (571f066d-c9f1-4850-bbf7-21c608823124): created successfully Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f864bf9d-5247-4a44-ad56-30dd743e0cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Flow 'volume_create_manager' (cb4651c8-28e8-49a3-ab3c-2a26722bc2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:17:33 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-364f95bb-7bdd-4542-9a0a-90ecbf64ecb8 tempest-TestInstancesWithCinderVolumes-2072538964 None] Created volume successfully. Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089ad459-a740-4231-96fc-115986e59d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee21e694-ea66-4058-882e-f6d437fa8a40', 'volume_name': 'volume-ee21e694-ea66-4058-882e-f6d437fa8a40', 'volume_size': 1, 'image_id': '80c15572-9a1c-42d9-a0da-6e07b44a3036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80c15572-9a1c-42d9-a0da-6e07b44a3036', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2103434784', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '80bf7eec580e46388a05b38ad9effb7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80c15572-9a1c-42d9-a0da-6e07b44a3036', 'created_at': datetime.datetime(2026, 8, 31, 23, 17, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 17, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80c15572-9a1c-42d9-a0da-6e07b44a3036/file', 'properties': {}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a227cf-9c8a-42b7-b014-1b27f0718050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a227cf-9c8a-42b7-b014-1b27f0718050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f770ce18-0d62-4fc8-baa2-c78944839b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:33 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Volume ee21e694-ea66-4058-882e-f6d437fa8a40: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee21e694-ea66-4058-882e-f6d437fa8a40', 'volume_size': 1, 'image_id': '80c15572-9a1c-42d9-a0da-6e07b44a3036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80c15572-9a1c-42d9-a0da-6e07b44a3036', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2103434784', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '80bf7eec580e46388a05b38ad9effb7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80c15572-9a1c-42d9-a0da-6e07b44a3036', 'created_at': datetime.datetime(2026, 8, 31, 23, 17, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 17, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80c15572-9a1c-42d9-a0da-6e07b44a3036/file', 'properties': {}}, 'image_service': } Sep 01 01:17:33 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Trying to clone ee21e694-ea66-4058-882e-f6d437fa8a40 from image 80c15572-9a1c-42d9-a0da-6e07b44a3036 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80c15572-9a1c-42d9-a0da-6e07b44a3036', 'metadata': {}}]). {{(pid=87064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:17:34 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697 1073741824" returned: 0 in 0.761s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:34 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697 Sep 01 01:17:34 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:34 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697" returned: 0 in 0.345s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:17:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf040130-3b30-4cc8-a72a-bd8cc929f255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf6b014-e530-45f1-bd2e-98d061ead1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:34 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Volume volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697 (bdc7d6e8-5ff6-47ce-8186-cc97abec2697): created successfully Sep 01 01:17:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf6b014-e530-45f1-bd2e-98d061ead1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Flow 'volume_create_manager' (48646550-7c72-4241-894a-673dfae768e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:17:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e7dc79a3-ce18-4e1a-8dae-fbd6f2dc8e01 tempest-TestInstancesWithCinderVolumes-2072538964 None] Created volume successfully. Sep 01 01:17:37 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD, size 20.69 MB, duration 4.17 sec {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:17:37 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Image download 20.69 MB at 4.96 MB/s Sep 01 01:17:37 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2857d32d-dc94-41b1-b478-50d013fce557]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:38 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD Sep 01 01:17:38 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:38 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Temporary image 80c15572-9a1c-42d9-a0da-6e07b44a3036 is fetched for user 550b794732ee4f038790dac1829cff85. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e05576d-7711-40a5-8ddc-b0c510c99263]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:38 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD Sep 01 01:17:38 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:38 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1709507000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee21e694-ea66-4058-882e-f6d437fa8a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80bf7eec580e46388a05b38ad9effb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:17:33Z,use_quota=True,user_id='550b794732ee4f038790dac1829cff85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4abff66e-8ff4-488e-86eb-22988bfc0b8e),volume_type_id=4abff66e-8ff4-488e-86eb-22988bfc0b8e)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Creating volume ee21e694-ea66-4058-882e-f6d437fa8a40 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:17:38 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:17:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:38 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 1073741824 Sep 01 01:17:38 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:39 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 1073741824" returned: 0 in 0.469s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:39 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 Sep 01 01:17:39 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:39 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40" returned: 0 in 0.263s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:17:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:39 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Attempting download of 80c15572-9a1c-42d9-a0da-6e07b44a3036 ((None, [{'url': 'file:///opt/stack/data/glance/images/80c15572-9a1c-42d9-a0da-6e07b44a3036', 'metadata': {}}])) to volume ee21e694-ea66-4058-882e-f6d437fa8a40. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:17:39 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0bf29b-6333-4035-a316-de5463a3a62d]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80c15572-9a1c-42d9-a0da-6e07b44a3036_kk3i1y00 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:39 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80c15572-9a1c-42d9-a0da-6e07b44a3036_kk3i1y00 Sep 01 01:17:39 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:40 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80c15572-9a1c-42d9-a0da-6e07b44a3036_kk3i1y00" returned: 0 in 0.388s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80c15572-9a1c-42d9-a0da-6e07b44a3036_kk3i1y00 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:40 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80c15572-9a1c-42d9-a0da-6e07b44a3036_kk3i1y00 Sep 01 01:17:40 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:40 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80c15572-9a1c-42d9-a0da-6e07b44a3036_kk3i1y00" returned: 1 in 0.415s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80c15572-9a1c-42d9-a0da-6e07b44a3036_kk3i1y00' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:17:40 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebeb441-42f9-4f0b-9027-60e820f86dae]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:17:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:40 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD Sep 01 01:17:40 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:40 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:40 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] 80c15572-9a1c-42d9-a0da-6e07b44a3036 was qcow2, converting to qcow2 {{(pid=87064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:17:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:40 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 Sep 01 01:17:40 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:43 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40" returned: 0 in 2.277s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80c15572-9a1c-42d9-a0da-6e07b44a3036_ox2qdbx5devstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:17:43 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Converted 112.00 MB image at 49.17 MB/s Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:43 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 1G Sep 01 01:17:43 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:43 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 1G" returned: 0 in 0.375s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Downloaded image 80c15572-9a1c-42d9-a0da-6e07b44a3036 ((None, [{'url': 'file:///opt/stack/data/glance/images/80c15572-9a1c-42d9-a0da-6e07b44a3036', 'metadata': {}}])) to volume ee21e694-ea66-4058-882e-f6d437fa8a40 successfully. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Temporary image 80c15572-9a1c-42d9-a0da-6e07b44a3036 for user 550b794732ee4f038790dac1829cff85 is deleted. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Marking volume ee21e694-ea66-4058-882e-f6d437fa8a40 as bootable. {{(pid=87064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Copying metadata from image 80c15572-9a1c-42d9-a0da-6e07b44a3036 to ee21e694-ea66-4058-882e-f6d437fa8a40. {{(pid=87064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Creating volume glance metadata for volume ee21e694-ea66-4058-882e-f6d437fa8a40 backed by image 80c15572-9a1c-42d9-a0da-6e07b44a3036 with: {'image_id': '80c15572-9a1c-42d9-a0da-6e07b44a3036', 'image_name': 'tempest-scenario-img--2103434784', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f770ce18-0d62-4fc8-baa2-c78944839b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee21e694-ea66-4058-882e-f6d437fa8a40', 'volume_size': 1, 'image_id': '80c15572-9a1c-42d9-a0da-6e07b44a3036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80c15572-9a1c-42d9-a0da-6e07b44a3036', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2103434784', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '80bf7eec580e46388a05b38ad9effb7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80c15572-9a1c-42d9-a0da-6e07b44a3036', 'created_at': datetime.datetime(2026, 8, 31, 23, 17, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 17, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80c15572-9a1c-42d9-a0da-6e07b44a3036/file', 'properties': {}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c563ad52-dbc4-42b0-a921-b27d8d9ec6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:17:43 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Volume volume-ee21e694-ea66-4058-882e-f6d437fa8a40 (ee21e694-ea66-4058-882e-f6d437fa8a40): created successfully Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c563ad52-dbc4-42b0-a921-b27d8d9ec6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:17:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Flow 'volume_create_manager' (148142ca-e92e-4b0d-b80e-012b1b46e6b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:17:43 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-735a9a32-6c61-44b0-a358-d98ed6b7db8d tempest-TestInstancesWithCinderVolumes-2072538964 None] Created volume successfully. Sep 01 01:17:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-a67c8b10-0fa5-4d39-a0b1-45d062609595 req-891316b1-d373-4761-bff2-d93b9a9901e5 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-a67c8b10-0fa5-4d39-a0b1-45d062609595 req-891316b1-d373-4761-bff2-d93b9a9901e5 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-a67c8b10-0fa5-4d39-a0b1-45d062609595 req-891316b1-d373-4761-bff2-d93b9a9901e5 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-a67c8b10-0fa5-4d39-a0b1-45d062609595 req-891316b1-d373-4761-bff2-d93b9a9901e5 tempest-TestInstancesWithCinderVolumes-2072538964 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-ee21e694-ea66-4058-882e-f6d437fa8a40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd842e58-382c-46a9-8bdc-9f3ce59c8fee', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:17:47 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-a67c8b10-0fa5-4d39-a0b1-45d062609595 req-891316b1-d373-4761-bff2-d93b9a9901e5 tempest-TestInstancesWithCinderVolumes-2072538964 None] attachment_update completed successfully. Sep 01 01:17:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:17:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:17:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:17:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:17:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:17:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:17:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:17:52 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:17:52 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:17:53 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 01 01:17:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.377s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:17:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:17:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:17:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:17:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:17:57 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=21,cinder:UPDATE=11,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:17:57 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=14,cinder:SELECT=16,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Flow 'volume_create_manager' (9e2b0a23-3feb-40ed-9a77-ce9752d79742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e8b8cc-02cf-42f0-ab07-a089fec8037c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e8b8cc-02cf-42f0-ab07-a089fec8037c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-382771449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51097970-2215-4c85-a79c-76200f1b8b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689a2acda6c546d1a333e80100f708c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:18:02Z,use_quota=True,user_id='f9c1bb2401574d66a62a4f1e7369259f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3034cdd5-49f5-414e-a229-b1f488788db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3034cdd5-49f5-414e-a229-b1f488788db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3f3037-5441-4954-9322-ae36c0bdb24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3f3037-5441-4954-9322-ae36c0bdb24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51097970-2215-4c85-a79c-76200f1b8b77', 'volume_name': 'volume-51097970-2215-4c85-a79c-76200f1b8b77', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf14be0-b306-4c69-9e21-3eb44a58bef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf14be0-b306-4c69-9e21-3eb44a58bef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464c2593-53cd-473a-98a4-75a1515bd516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:18:02 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Volume 51097970-2215-4c85-a79c-76200f1b8b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51097970-2215-4c85-a79c-76200f1b8b77', 'volume_size': 1} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-382771449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51097970-2215-4c85-a79c-76200f1b8b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689a2acda6c546d1a333e80100f708c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:18:02Z,use_quota=True,user_id='f9c1bb2401574d66a62a4f1e7369259f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Creating volume 51097970-2215-4c85-a79c-76200f1b8b77 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:18:02 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:18:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:02 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77 1073741824 Sep 01 01:18:02 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:03 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77 1073741824" returned: 0 in 0.665s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:03 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77 Sep 01 01:18:03 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:03 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77" returned: 0 in 0.411s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:03 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:18:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:18:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464c2593-53cd-473a-98a4-75a1515bd516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51097970-2215-4c85-a79c-76200f1b8b77', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:18:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ececc50-20e6-418b-b2a4-a4ade7bdf91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:18:03 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Volume volume-51097970-2215-4c85-a79c-76200f1b8b77 (51097970-2215-4c85-a79c-76200f1b8b77): created successfully Sep 01 01:18:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ececc50-20e6-418b-b2a4-a4ade7bdf91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:18:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Flow 'volume_create_manager' (9e2b0a23-3feb-40ed-9a77-ce9752d79742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:18:03 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b0db18a8-f5a2-426f-823c-750bc176017e tempest-TestMinimumBasicScenario-323423447 None] Created volume successfully. Sep 01 01:18:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-45ee875e-8a74-4e3c-a430-f8ab2779b36f req-3aca5b70-f67a-4ae4-88bf-23f437cc0ab6 tempest-TestMinimumBasicScenario-323423447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:18:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-45ee875e-8a74-4e3c-a430-f8ab2779b36f req-3aca5b70-f67a-4ae4-88bf-23f437cc0ab6 tempest-TestMinimumBasicScenario-323423447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:18:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-45ee875e-8a74-4e3c-a430-f8ab2779b36f req-3aca5b70-f67a-4ae4-88bf-23f437cc0ab6 tempest-TestMinimumBasicScenario-323423447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:18:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-45ee875e-8a74-4e3c-a430-f8ab2779b36f req-3aca5b70-f67a-4ae4-88bf-23f437cc0ab6 tempest-TestMinimumBasicScenario-323423447 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-51097970-2215-4c85-a79c-76200f1b8b77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c26ba179-8952-4e8d-a5ab-fd8bd866330f', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:18:05 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-45ee875e-8a74-4e3c-a430-f8ab2779b36f req-3aca5b70-f67a-4ae4-88bf-23f437cc0ab6 tempest-TestMinimumBasicScenario-323423447 None] attachment_update completed successfully. Sep 01 01:18:15 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=8 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:18:15 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:18:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8d320541-3325-4136-b234-550357739cff req-32d18691-e3cb-44dd-84e3-5f99ab0c6bd7 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:18:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8d320541-3325-4136-b234-550357739cff req-32d18691-e3cb-44dd-84e3-5f99ab0c6bd7 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:18:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8d320541-3325-4136-b234-550357739cff req-32d18691-e3cb-44dd-84e3-5f99ab0c6bd7 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:18:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-8d320541-3325-4136-b234-550357739cff req-32d18691-e3cb-44dd-84e3-5f99ab0c6bd7 tempest-TestInstancesWithCinderVolumes-2072538964 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-571f066d-c9f1-4850-bbf7-21c608823124', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7b4fc15-0ce4-481d-b35d-0f339cdf7754', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:18:24 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-8d320541-3325-4136-b234-550357739cff req-32d18691-e3cb-44dd-84e3-5f99ab0c6bd7 tempest-TestInstancesWithCinderVolumes-2072538964 None] attachment_update completed successfully. Sep 01 01:18:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5dfaa0e0-6106-4263-ad62-b6e633287e04 req-f8134652-8059-4aa9-a1f3-1a35a36682fb tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:18:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5dfaa0e0-6106-4263-ad62-b6e633287e04 req-f8134652-8059-4aa9-a1f3-1a35a36682fb tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:18:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5dfaa0e0-6106-4263-ad62-b6e633287e04 req-f8134652-8059-4aa9-a1f3-1a35a36682fb tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:18:26 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5dfaa0e0-6106-4263-ad62-b6e633287e04 req-f8134652-8059-4aa9-a1f3-1a35a36682fb tempest-TestInstancesWithCinderVolumes-2072538964 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc474ef9-9d7f-43b4-ae22-72e94313a7d0', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:18:26 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-5dfaa0e0-6106-4263-ad62-b6e633287e04 req-f8134652-8059-4aa9-a1f3-1a35a36682fb tempest-TestInstancesWithCinderVolumes-2072538964 None] attachment_update completed successfully. Sep 01 01:18:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-873d76a0-924b-425e-9553-f12a174c9f7f req-4cacdf1b-59b2-42b4-a969-8e7b4fd0f705 tempest-TestInstancesWithCinderVolumes-2072538964 None] Terminate volume connection completed successfully. Sep 01 01:18:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-873d76a0-924b-425e-9553-f12a174c9f7f req-4cacdf1b-59b2-42b4-a969-8e7b4fd0f705 tempest-TestInstancesWithCinderVolumes-2072538964 None] Deleting attachment f7b4fc15-0ce4-481d-b35d-0f339cdf7754. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:18:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "cinder-571f066d-c9f1-4850-bbf7-21c608823124-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:18:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-571f066d-c9f1-4850-bbf7-21c608823124-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:18:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "cinder-quobyte-571f066d-c9f1-4850-bbf7-21c608823124" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:18:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-quobyte-571f066d-c9f1-4850-bbf7-21c608823124" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:18:33 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cfb294-5087-494f-8c39-7153e9899e2c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:18:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:33 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124 Sep 01 01:18:33 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:33 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124" returned: 0 in 0.410s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:33 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124 Sep 01 01:18:33 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:33 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-571f066d-c9f1-4850-bbf7-21c608823124" returned: 0 in 0.324s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-quobyte-571f066d-c9f1-4850-bbf7-21c608823124" released by "delete_volume" :: held 0.785s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:18:33 devstack cinder-volume[87064]: WARNING cinder.quota [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098932894-1719551169 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098932894-1719551169, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:18:33 devstack cinder-volume[87064]: WARNING cinder.quota [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098932894-1719551169 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098932894-1719551169, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:18:33 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Created reservations ['a4bd9b51-3ff9-4c55-bd3e-4a00149b1bb9', '81d460cb-9528-40dd-9f82-54d5d5ea2585', '0575ade9-ad3c-4bc2-98be-0f99665d5ea5', '0a145614-7e12-4a41-ab27-cf32769081dd'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:18:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:18:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:18:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:18:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:18:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:18:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:34 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:18:34 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:34 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.317s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:34 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:18:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Deleted volume successfully. Sep 01 01:18:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73504aec-338e-4ae7-af98-dcbb9ea80d50 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-571f066d-c9f1-4850-bbf7-21c608823124-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:18:37 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-07eb2c39-2218-45b1-951e-f0f98419f795 req-46b3df7c-4617-430c-b8e6-dff383a76558 tempest-TestInstancesWithCinderVolumes-2072538964 None] Terminate volume connection completed successfully. Sep 01 01:18:37 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-07eb2c39-2218-45b1-951e-f0f98419f795 req-46b3df7c-4617-430c-b8e6-dff383a76558 tempest-TestInstancesWithCinderVolumes-2072538964 None] Deleting attachment fc474ef9-9d7f-43b4-ae22-72e94313a7d0. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:18:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "cinder-bdc7d6e8-5ff6-47ce-8186-cc97abec2697-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:18:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-bdc7d6e8-5ff6-47ce-8186-cc97abec2697-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:18:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "cinder-quobyte-bdc7d6e8-5ff6-47ce-8186-cc97abec2697" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:18:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-quobyte-bdc7d6e8-5ff6-47ce-8186-cc97abec2697" acquired by "delete_volume" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:18:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[938afd65-75c4-4fc0-9074-e37541cf1264]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:18:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:38 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697 Sep 01 01:18:38 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:38 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697" returned: 0 in 0.528s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:38 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697 Sep 01 01:18:38 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:38 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-bdc7d6e8-5ff6-47ce-8186-cc97abec2697" returned: 0 in 0.322s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-quobyte-bdc7d6e8-5ff6-47ce-8186-cc97abec2697" released by "delete_volume" :: held 0.908s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:18:38 devstack cinder-volume[87064]: WARNING cinder.quota [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-578156856-1755651645 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-578156856-1755651645, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:18:38 devstack cinder-volume[87064]: WARNING cinder.quota [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-578156856-1755651645 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-578156856-1755651645, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:18:39 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Created reservations ['14542bb2-24c2-484a-ac1a-4c41b94a54b4', '98d202c7-6bbd-414e-a94e-c95790b41252', '31798e15-fe58-401b-90de-a47b499d8cf2', '91f74601-190b-484c-be8a-c24729cc0fc6'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:18:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:18:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:18:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:18:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:18:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:18:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:39 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:18:39 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:39 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.354s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:39 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:18:39 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Deleted volume successfully. Sep 01 01:18:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-da8fb43e-da46-41b7-b574-9a3f2dd5b562 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-bdc7d6e8-5ff6-47ce-8186-cc97abec2697-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:18:43 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-42b25b91-2920-4ffb-b959-3eb3b5d7dc31 req-7d65e978-1e07-4fc1-be7c-ba863a44cd1e tempest-TestInstancesWithCinderVolumes-2072538964 None] Terminate volume connection completed successfully. Sep 01 01:18:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-42b25b91-2920-4ffb-b959-3eb3b5d7dc31 req-7d65e978-1e07-4fc1-be7c-ba863a44cd1e tempest-TestInstancesWithCinderVolumes-2072538964 None] Deleting attachment bd842e58-382c-46a9-8bdc-9f3ce59c8fee. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:18:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "cinder-ee21e694-ea66-4058-882e-f6d437fa8a40-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:18:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-ee21e694-ea66-4058-882e-f6d437fa8a40-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:18:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "cinder-quobyte-ee21e694-ea66-4058-882e-f6d437fa8a40" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:18:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-quobyte-ee21e694-ea66-4058-882e-f6d437fa8a40" acquired by "delete_volume" :: waited 0.012s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:18:44 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e9d07f-8528-4edf-9ff3-a4fe7d2b6511]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:18:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:44 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 Sep 01 01:18:44 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:44 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40" returned: 0 in 0.391s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:44 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40 Sep 01 01:18:44 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:44 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ee21e694-ea66-4058-882e-f6d437fa8a40" returned: 0 in 0.256s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-quobyte-ee21e694-ea66-4058-882e-f6d437fa8a40" released by "delete_volume" :: held 0.686s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:18:44 devstack cinder-volume[87064]: WARNING cinder.quota [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1085533657-1794512196 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1085533657-1794512196, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:18:44 devstack cinder-volume[87064]: WARNING cinder.quota [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1085533657-1794512196 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1085533657-1794512196, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:18:45 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Created reservations ['853c3dac-7188-4fe0-9c04-ea80718150f9', 'b5d42667-ec5f-41af-b482-93a2c3a2a7d3', 'cca9fb10-cf2f-45f8-8925-334cc7cbcff0', '91abf502-3867-4cec-ad49-833b8d858735'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:18:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:18:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:18:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:18:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:18:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:18:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:45 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:18:45 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:45 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.248s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:45 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:18:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Deleted volume successfully. Sep 01 01:18:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-57394e6d-2411-465f-9658-3ba326694090 tempest-TestInstancesWithCinderVolumes-2072538964 None] Lock "cinder-ee21e694-ea66-4058-882e-f6d437fa8a40-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:18:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:18:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:18:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:18:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:18:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:18:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:18:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:52 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:18:52 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:53 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.381s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:18:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:18:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:18:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:18:53 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-8d0effe9-b76e-4743-ae8b-9259ab8be979 req-9fdbabbf-0b2e-4307-88da-efd717524c8d tempest-TestMinimumBasicScenario-323423447 None] Terminate volume connection completed successfully. Sep 01 01:18:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-8d0effe9-b76e-4743-ae8b-9259ab8be979 req-9fdbabbf-0b2e-4307-88da-efd717524c8d tempest-TestMinimumBasicScenario-323423447 None] Deleting attachment c26ba179-8952-4e8d-a5ab-fd8bd866330f. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:18:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Acquiring lock "cinder-51097970-2215-4c85-a79c-76200f1b8b77-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:18:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Lock "cinder-51097970-2215-4c85-a79c-76200f1b8b77-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:18:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Acquiring lock "cinder-quobyte-51097970-2215-4c85-a79c-76200f1b8b77" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:18:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Lock "cinder-quobyte-51097970-2215-4c85-a79c-76200f1b8b77" acquired by "delete_volume" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:18:54 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ee3471-e734-4d68-8f28-d851bf795d9a]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:18:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:54 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77 Sep 01 01:18:54 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:54 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77" returned: 0 in 0.427s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:54 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77 Sep 01 01:18:54 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:55 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-51097970-2215-4c85-a79c-76200f1b8b77" returned: 0 in 0.245s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Lock "cinder-quobyte-51097970-2215-4c85-a79c-76200f1b8b77" released by "delete_volume" :: held 0.720s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Created reservations ['2a54e49d-be3e-4337-ac07-91c7777460ea', '1ca2931e-03e4-47ba-91d0-c9f4db4a3125', '2c40b8f5-6c08-4778-be27-f0bbb8ec0c5e', '1262ff23-099b-4487-acad-48a4991861cc'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:18:55 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:18:55 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:18:55 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.253s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:18:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Deleted volume successfully. Sep 01 01:18:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ab201121-edb6-410b-8faa-961dec9e2c69 tempest-TestMinimumBasicScenario-323423447 None] Lock "cinder-51097970-2215-4c85-a79c-76200f1b8b77-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:19:05 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=38,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:19:05 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=36,cinder:UPDATE=37,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Flow 'volume_create_manager' (756c2f73-7899-4f1e-8bb0-fec68adedbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30c1b72-58ee-4226-8bc0-49790acc3033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30c1b72-58ee-4226-8bc0-49790acc3033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1312732070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8398ab99-ece5-4d76-ae23-33ac5d5d7232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fa6575252d45ca8a509b5a77962981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:19:24Z,use_quota=True,user_id='cc01ba771b224086b689f3dc0483d402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add3f5a8-7d09-4930-997c-5882087c1033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add3f5a8-7d09-4930-997c-5882087c1033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4d1b3c-437d-48bc-a164-88136aee4db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4d1b3c-437d-48bc-a164-88136aee4db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8398ab99-ece5-4d76-ae23-33ac5d5d7232', 'volume_name': 'volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5450668f-3cc0-4cd5-950a-35367d211560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5450668f-3cc0-4cd5-950a-35367d211560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0a33db-df0c-44dd-854a-049001e53355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:23 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Volume 8398ab99-ece5-4d76-ae23-33ac5d5d7232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232', 'volume_size': 1} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1312732070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8398ab99-ece5-4d76-ae23-33ac5d5d7232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fa6575252d45ca8a509b5a77962981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:19:24Z,use_quota=True,user_id='cc01ba771b224086b689f3dc0483d402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Creating volume 8398ab99-ece5-4d76-ae23-33ac5d5d7232 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:19:23 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:19:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:19:23 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232 1073741824 Sep 01 01:19:23 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Flow 'volume_create_manager' (6601f3b8-2bc1-4dc7-8ad4-20a930f988dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931452ca-6eb1-4d01-9060-47a0ad2cd168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931452ca-6eb1-4d01-9060-47a0ad2cd168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1368517904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc443b6-8f46-4a58-a3a1-2ea8243d20d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fa6575252d45ca8a509b5a77962981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:19:24Z,use_quota=True,user_id='cc01ba771b224086b689f3dc0483d402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba060c2-3d6a-49df-9c84-5ff51919fc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba060c2-3d6a-49df-9c84-5ff51919fc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668bd8f1-1f83-4d32-8eff-7d00792d59b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668bd8f1-1f83-4d32-8eff-7d00792d59b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc443b6-8f46-4a58-a3a1-2ea8243d20d1', 'volume_name': 'volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a5823f-ef0e-4641-ac76-53c03c8d55fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a5823f-ef0e-4641-ac76-53c03c8d55fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6c94a5-5c03-49f7-9f72-9cc84229f76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:24 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Volume 7fc443b6-8f46-4a58-a3a1-2ea8243d20d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1', 'volume_size': 1} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:19:24 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232 1073741824" returned: 0 in 0.750s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:19:24 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232 Sep 01 01:19:24 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:19:24 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232" returned: 0 in 0.332s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.661s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1368517904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc443b6-8f46-4a58-a3a1-2ea8243d20d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fa6575252d45ca8a509b5a77962981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:19:24Z,use_quota=True,user_id='cc01ba771b224086b689f3dc0483d402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Creating volume 7fc443b6-8f46-4a58-a3a1-2ea8243d20d1 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:19:24 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:19:24 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1 1073741824 Sep 01 01:19:24 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0a33db-df0c-44dd-854a-049001e53355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1be71e-3246-4570-a5ff-a98430f47ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:24 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Volume volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232 (8398ab99-ece5-4d76-ae23-33ac5d5d7232): created successfully Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1be71e-3246-4570-a5ff-a98430f47ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Flow 'volume_create_manager' (756c2f73-7899-4f1e-8bb0-fec68adedbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:19:24 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-786a9e51-9e44-4169-b25f-8a03abfba290 tempest-TestServerVolumeAttachmentScenario-201815789 None] Created volume successfully. Sep 01 01:19:25 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 01 01:19:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1 1073741824" returned: 0 in 0.540s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:19:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:19:25 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1 Sep 01 01:19:25 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:19:25 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 01 01:19:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1" returned: 0 in 0.292s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:19:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:19:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:19:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6c94a5-5c03-49f7-9f72-9cc84229f76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80cdda3-0d6a-499d-a95c-5153f4360592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:19:25 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Volume volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1 (7fc443b6-8f46-4a58-a3a1-2ea8243d20d1): created successfully Sep 01 01:19:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80cdda3-0d6a-499d-a95c-5153f4360592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:19:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Flow 'volume_create_manager' (6601f3b8-2bc1-4dc7-8ad4-20a930f988dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:19:25 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9fb76cf8-a920-4f13-98f2-7322b9244b90 tempest-TestServerVolumeAttachmentScenario-201815789 None] Created volume successfully. Sep 01 01:19:42 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:19:42 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:19:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:19:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:19:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:19:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:19:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:19:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:19:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:19:52 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:19:52 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:19:53 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 01 01:19:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.297s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:19:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:19:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:19:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:19:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:19:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ddfc7023-56c4-4c1e-883e-7bbe145e9edd req-c970888f-81a7-4d5e-86b5-9e9d6c8e1e63 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:19:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ddfc7023-56c4-4c1e-883e-7bbe145e9edd req-c970888f-81a7-4d5e-86b5-9e9d6c8e1e63 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:19:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ddfc7023-56c4-4c1e-883e-7bbe145e9edd req-c970888f-81a7-4d5e-86b5-9e9d6c8e1e63 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:19:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ddfc7023-56c4-4c1e-883e-7bbe145e9edd req-c970888f-81a7-4d5e-86b5-9e9d6c8e1e63 tempest-TestServerVolumeAttachmentScenario-201815789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0aafbb40-c48c-4888-9a98-acd777b6173a', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:19:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-ddfc7023-56c4-4c1e-883e-7bbe145e9edd req-c970888f-81a7-4d5e-86b5-9e9d6c8e1e63 tempest-TestServerVolumeAttachmentScenario-201815789 None] attachment_update completed successfully. Sep 01 01:20:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5f8c4804-d9c5-4225-afc5-3fee4b652342 req-0c8389af-bf0b-47fc-a619-7ab790d4f1b4 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5f8c4804-d9c5-4225-afc5-3fee4b652342 req-0c8389af-bf0b-47fc-a619-7ab790d4f1b4 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-5f8c4804-d9c5-4225-afc5-3fee4b652342 req-0c8389af-bf0b-47fc-a619-7ab790d4f1b4 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-5f8c4804-d9c5-4225-afc5-3fee4b652342 req-0c8389af-bf0b-47fc-a619-7ab790d4f1b4 tempest-TestServerVolumeAttachmentScenario-201815789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50fe39df-edc9-4c94-9b9a-bc4957b90ca6', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:20:05 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-5f8c4804-d9c5-4225-afc5-3fee4b652342 req-0c8389af-bf0b-47fc-a619-7ab790d4f1b4 tempest-TestServerVolumeAttachmentScenario-201815789 None] attachment_update completed successfully. Sep 01 01:20:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-324266a9-67b1-4ddc-bb96-56a2586fcf83 req-f3a641df-4bdf-4630-a834-acac443867f8 tempest-TestServerVolumeAttachmentScenario-201815789 None] Terminate volume connection completed successfully. Sep 01 01:20:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-324266a9-67b1-4ddc-bb96-56a2586fcf83 req-f3a641df-4bdf-4630-a834-acac443867f8 tempest-TestServerVolumeAttachmentScenario-201815789 None] Deleting attachment 50fe39df-edc9-4c94-9b9a-bc4957b90ca6. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:20:08 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-e10b0d64-b62e-4712-909b-9aaacd61353e req-1ed05dc2-9a3c-4cb9-84f6-84918afe8586 tempest-TestServerVolumeAttachmentScenario-201815789 None] Terminate volume connection completed successfully. Sep 01 01:20:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-e10b0d64-b62e-4712-909b-9aaacd61353e req-1ed05dc2-9a3c-4cb9-84f6-84918afe8586 tempest-TestServerVolumeAttachmentScenario-201815789 None] Deleting attachment 0aafbb40-c48c-4888-9a98-acd777b6173a. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:20:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "cinder-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "cinder-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "cinder-quobyte-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "cinder-quobyte-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1" acquired by "delete_volume" :: waited 0.014s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:12 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b48d2b9-0e06-4179-9332-9096f349e3ae]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:12 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1 Sep 01 01:20:12 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:13 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1" returned: 0 in 0.356s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:13 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1 Sep 01 01:20:13 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:13 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1" returned: 0 in 0.236s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "cinder-quobyte-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1" released by "delete_volume" :: held 0.634s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Created reservations ['0db91fba-6ab9-4a0a-b786-8adc7642e163', '620fd5e5-b15e-449c-8fc0-942838f1d2a7', '26cfe633-ae86-4c66-8b13-3fa20aaa0a35', 'fdf689bf-a202-4fc7-8973-20f5fc1470d4'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:13 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:20:13 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:13 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.243s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:20:13 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Deleted volume successfully. Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-50fab261-94f4-4585-b86d-66b54261b746 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "cinder-7fc443b6-8f46-4a58-a3a1-2ea8243d20d1-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "cinder-8398ab99-ece5-4d76-ae23-33ac5d5d7232-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "cinder-8398ab99-ece5-4d76-ae23-33ac5d5d7232-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "cinder-quobyte-8398ab99-ece5-4d76-ae23-33ac5d5d7232" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "cinder-quobyte-8398ab99-ece5-4d76-ae23-33ac5d5d7232" acquired by "delete_volume" :: waited 0.013s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7cf341-9062-4122-965a-ba45a7296be4]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:14 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232 Sep 01 01:20:14 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:14 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232" returned: 0 in 0.345s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:14 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232 Sep 01 01:20:14 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:14 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8398ab99-ece5-4d76-ae23-33ac5d5d7232" returned: 0 in 0.238s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "cinder-quobyte-8398ab99-ece5-4d76-ae23-33ac5d5d7232" released by "delete_volume" :: held 0.620s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Created reservations ['7b5f1ffc-b6e5-46d4-9bcd-1ddb2b54d373', '02888e76-4dfd-467f-a3ad-2e89f93ae387', 'feaa246e-1fcf-4c08-862d-dc14ca43f693', '598dae56-7184-44af-ba48-1e4dda3231b9'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:14 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:20:14 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:14 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.241s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:20:14 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Deleted volume successfully. Sep 01 01:20:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a49c584a-1d93-4a7a-a853-37b18e9c5d65 tempest-TestServerVolumeAttachmentScenario-201815789 None] Lock "cinder-8398ab99-ece5-4d76-ae23-33ac5d5d7232-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Flow 'volume_create_manager' (1de3bf46-92d7-4961-9bcd-4bf257550072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56ecc63-d878-492b-abf1-22cef1703c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56ecc63-d878-492b-abf1-22cef1703c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-494443882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04250407-02dd-4d03-b8e9-b8657e999ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc65966f18de4dba9b4c929cabe815bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:18Z,use_quota=True,user_id='5679e43bbc1140c1b829bd876ef9145c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2b13a8-930b-41b5-895a-71a915580a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2b13a8-930b-41b5-895a-71a915580a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c66921-a54d-42cb-967f-9b8d24f492f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c66921-a54d-42cb-967f-9b8d24f492f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04250407-02dd-4d03-b8e9-b8657e999ea0', 'volume_name': 'volume-04250407-02dd-4d03-b8e9-b8657e999ea0', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a91d9b3-fd1a-41be-b64a-aa9941a9f24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a91d9b3-fd1a-41be-b64a-aa9941a9f24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8ed4db-6953-4312-bf5b-6753f474df2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:18 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Volume 04250407-02dd-4d03-b8e9-b8657e999ea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04250407-02dd-4d03-b8e9-b8657e999ea0', 'volume_size': 1} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-494443882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04250407-02dd-4d03-b8e9-b8657e999ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc65966f18de4dba9b4c929cabe815bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:18Z,use_quota=True,user_id='5679e43bbc1140c1b829bd876ef9145c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Creating volume 04250407-02dd-4d03-b8e9-b8657e999ea0 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:20:18 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:18 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0 1073741824 Sep 01 01:20:18 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:18 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0 1073741824" returned: 0 in 0.473s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:18 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0 Sep 01 01:20:18 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:19 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0" returned: 0 in 0.279s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:20:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8ed4db-6953-4312-bf5b-6753f474df2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04250407-02dd-4d03-b8e9-b8657e999ea0', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf85f5f-6f3e-4c7f-bb04-cf2d44f6e8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:19 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Volume volume-04250407-02dd-4d03-b8e9-b8657e999ea0 (04250407-02dd-4d03-b8e9-b8657e999ea0): created successfully Sep 01 01:20:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf85f5f-6f3e-4c7f-bb04-cf2d44f6e8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Flow 'volume_create_manager' (1de3bf46-92d7-4961-9bcd-4bf257550072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:19 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0033013a-a273-49c8-a890-9f9b2d34d5b6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Created volume successfully. Sep 01 01:20:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8e8c2d85-7478-4f48-8e78-a8e216f9174c req-9e692780-541f-413c-b78f-54babe3caca6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8e8c2d85-7478-4f48-8e78-a8e216f9174c req-9e692780-541f-413c-b78f-54babe3caca6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-8e8c2d85-7478-4f48-8e78-a8e216f9174c req-9e692780-541f-413c-b78f-54babe3caca6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-8e8c2d85-7478-4f48-8e78-a8e216f9174c req-9e692780-541f-413c-b78f-54babe3caca6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-04250407-02dd-4d03-b8e9-b8657e999ea0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8ecd117-f6b7-4c13-a4a4-00c89ed29ece', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:20:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-8e8c2d85-7478-4f48-8e78-a8e216f9174c req-9e692780-541f-413c-b78f-54babe3caca6 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] attachment_update completed successfully. Sep 01 01:20:24 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-26fda782-3193-46eb-bb7e-08a596dcca82 req-0afec6e6-1cd8-4903-b0bd-a3360ae0c4c2 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Terminate volume connection completed successfully. Sep 01 01:20:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-26fda782-3193-46eb-bb7e-08a596dcca82 req-0afec6e6-1cd8-4903-b0bd-a3360ae0c4c2 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Deleting attachment e8ecd117-f6b7-4c13-a4a4-00c89ed29ece. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Acquiring lock "cinder-04250407-02dd-4d03-b8e9-b8657e999ea0-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "cinder-04250407-02dd-4d03-b8e9-b8657e999ea0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Acquiring lock "cinder-quobyte-04250407-02dd-4d03-b8e9-b8657e999ea0" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "cinder-quobyte-04250407-02dd-4d03-b8e9-b8657e999ea0" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d07215f-1324-4b5d-91c7-54266ef24ab2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:25 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0 Sep 01 01:20:25 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:25 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0" returned: 0 in 0.402s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:25 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0 Sep 01 01:20:25 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:25 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-04250407-02dd-4d03-b8e9-b8657e999ea0" returned: 0 in 0.261s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "cinder-quobyte-04250407-02dd-4d03-b8e9-b8657e999ea0" released by "delete_volume" :: held 0.708s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Created reservations ['5dd94f01-dea4-45b3-afcb-3f80b9132cc8', 'e5a939f3-723c-4fe0-8a8d-dc1820af0eba', '6e177d97-a166-474a-9fe6-d9095c72c7b1', '4c5ef845-5386-437e-a4f4-7ff8bac1988d'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:25 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:20:25 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:26 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.257s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:26 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:20:26 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Deleted volume successfully. Sep 01 01:20:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a50c3c99-b1a3-4f22-8fce-bbd6cf6c5426 tempest-TestServerVolumeAttachScenarioOldVersion-323024789 None] Lock "cinder-04250407-02dd-4d03-b8e9-b8657e999ea0-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Flow 'volume_create_manager' (873f07a7-686d-4d45-9c14-2f5546ffba7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275351dc-dfed-462f-a1d3-5327ef4d7405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275351dc-dfed-462f-a1d3-5327ef4d7405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2056031641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60f012a-ae67-4b47-98ec-c9993debf413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350f470b6bfd4e98adb25cb4e5041176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:29Z,use_quota=True,user_id='0d8a74f95dc74033a3ce05c9d5731b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d0f920-f6b7-48c1-8d45-e26d9fb1dd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d0f920-f6b7-48c1-8d45-e26d9fb1dd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a215c53-614a-4374-939b-f1b2d0097345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a215c53-614a-4374-939b-f1b2d0097345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b60f012a-ae67-4b47-98ec-c9993debf413', 'volume_name': 'volume-b60f012a-ae67-4b47-98ec-c9993debf413', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb77690e-e854-491f-a66d-0207e0d29ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb77690e-e854-491f-a66d-0207e0d29ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374848c3-c1e8-495f-b605-70778d99fc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:29 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Volume b60f012a-ae67-4b47-98ec-c9993debf413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b60f012a-ae67-4b47-98ec-c9993debf413', 'volume_size': 1} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2056031641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60f012a-ae67-4b47-98ec-c9993debf413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350f470b6bfd4e98adb25cb4e5041176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:29Z,use_quota=True,user_id='0d8a74f95dc74033a3ce05c9d5731b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Creating volume b60f012a-ae67-4b47-98ec-c9993debf413 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:20:29 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:29 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413 1073741824 Sep 01 01:20:29 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:29 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Flow 'volume_create_manager' (2912ea40-9741-441a-a5e4-34e0cd5ade65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa5f4fd-0aef-4681-9a35-da6ac0f77e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa5f4fd-0aef-4681-9a35-da6ac0f77e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1935380233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88461442-85c4-4b34-bf48-6beb1c011031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350f470b6bfd4e98adb25cb4e5041176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:30Z,use_quota=True,user_id='0d8a74f95dc74033a3ce05c9d5731b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc440e4-389d-4751-8dcf-aa6429fe0304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc440e4-389d-4751-8dcf-aa6429fe0304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8fba7c-a947-4537-8094-c9ceaaf070fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8fba7c-a947-4537-8094-c9ceaaf070fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88461442-85c4-4b34-bf48-6beb1c011031', 'volume_name': 'volume-88461442-85c4-4b34-bf48-6beb1c011031', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d18ec48-f4f9-441e-a05e-f03aa3ae88c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d18ec48-f4f9-441e-a05e-f03aa3ae88c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63719eba-de57-4ada-a7cf-ea112314db61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Volume 88461442-85c4-4b34-bf48-6beb1c011031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88461442-85c4-4b34-bf48-6beb1c011031', 'volume_size': 1} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:30 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413 1073741824" returned: 0 in 0.621s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:30 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413 Sep 01 01:20:30 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Flow 'volume_create_manager' (648eaeb6-8c30-4f7c-bf54-325574f6d598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5182b7f-6e01-497e-80fb-42203dd2c496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5182b7f-6e01-497e-80fb-42203dd2c496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-845775190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4633de5f-721c-45fc-8418-5ae7c8be838d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350f470b6bfd4e98adb25cb4e5041176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:30Z,use_quota=True,user_id='0d8a74f95dc74033a3ce05c9d5731b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fe7b1c-f98f-4bc1-b213-d270f406d664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fe7b1c-f98f-4bc1-b213-d270f406d664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f92330-944f-4a7d-ba27-1373224aae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f92330-944f-4a7d-ba27-1373224aae55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4633de5f-721c-45fc-8418-5ae7c8be838d', 'volume_name': 'volume-4633de5f-721c-45fc-8418-5ae7c8be838d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39f8d71-dadb-4662-a877-8f08c834600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39f8d71-dadb-4662-a877-8f08c834600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38daffe4-ef5d-45a0-aeca-880030504a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Volume 4633de5f-721c-45fc-8418-5ae7c8be838d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4633de5f-721c-45fc-8418-5ae7c8be838d', 'volume_size': 1} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:30 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413" returned: 0 in 0.321s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1935380233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88461442-85c4-4b34-bf48-6beb1c011031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350f470b6bfd4e98adb25cb4e5041176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:30Z,use_quota=True,user_id='0d8a74f95dc74033a3ce05c9d5731b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Creating volume 88461442-85c4-4b34-bf48-6beb1c011031 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:20:30 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374848c3-c1e8-495f-b605-70778d99fc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b60f012a-ae67-4b47-98ec-c9993debf413', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bc8ba1-5055-4049-a099-b873359a092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031 1073741824 Sep 01 01:20:30 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Volume volume-b60f012a-ae67-4b47-98ec-c9993debf413 (b60f012a-ae67-4b47-98ec-c9993debf413): created successfully Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bc8ba1-5055-4049-a099-b873359a092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Flow 'volume_create_manager' (873f07a7-686d-4d45-9c14-2f5546ffba7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:30 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-30495424-f4c1-485b-816c-5c918188a8fb tempest-CreateVolumesFromImageTest-1421330993 None] Created volume successfully. Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Flow 'volume_create_manager' (abdfea0f-c605-4fc5-a367-482b81f17c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3119837a-b579-4a7a-a8d6-6a761b3c6b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3119837a-b579-4a7a-a8d6-6a761b3c6b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104049474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1f59ae-c3a1-421c-af41-af063fe18c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350f470b6bfd4e98adb25cb4e5041176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:31Z,use_quota=True,user_id='0d8a74f95dc74033a3ce05c9d5731b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d05946-7da7-4b5f-9f8d-02b697b85b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d05946-7da7-4b5f-9f8d-02b697b85b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64937d68-0952-409a-a413-123b8117e2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64937d68-0952-409a-a413-123b8117e2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1f59ae-c3a1-421c-af41-af063fe18c87', 'volume_name': 'volume-4e1f59ae-c3a1-421c-af41-af063fe18c87', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a34aadf-c43a-4dcc-9508-6aa81e55b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a34aadf-c43a-4dcc-9508-6aa81e55b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d977a3ec-dab6-45b6-8348-c5ca402bd6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Volume 4e1f59ae-c3a1-421c-af41-af063fe18c87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1f59ae-c3a1-421c-af41-af063fe18c87', 'volume_size': 1} Sep 01 01:20:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:20:31 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Flow 'volume_create_manager' (e54ff30f-a9b8-4e6c-ae29-135041383594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7772d5f-7f4e-4701-acda-d9e5f873df16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031 1073741824" returned: 0 in 0.789s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7772d5f-7f4e-4701-acda-d9e5f873df16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1604483772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e90ec3-9adb-4f33-a631-dbc0607acffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350f470b6bfd4e98adb25cb4e5041176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:31Z,use_quota=True,user_id='0d8a74f95dc74033a3ce05c9d5731b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efad3972-ecac-4a7b-96f5-677b8d33b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efad3972-ecac-4a7b-96f5-677b8d33b05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3672ca-3ed1-4d11-9c68-9d995a9c8ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3672ca-3ed1-4d11-9c68-9d995a9c8ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e90ec3-9adb-4f33-a631-dbc0607acffd', 'volume_name': 'volume-39e90ec3-9adb-4f33-a631-dbc0607acffd', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5089d1-aa24-4871-b987-364452954c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5089d1-aa24-4871-b987-364452954c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f646304-c4bc-482d-9c54-00842891b380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:31 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Volume 39e90ec3-9adb-4f33-a631-dbc0607acffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e90ec3-9adb-4f33-a631-dbc0607acffd', 'volume_size': 1} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:31 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031 Sep 01 01:20:31 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:31 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031" returned: 0 in 0.260s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.254s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-845775190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4633de5f-721c-45fc-8418-5ae7c8be838d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350f470b6bfd4e98adb25cb4e5041176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:30Z,use_quota=True,user_id='0d8a74f95dc74033a3ce05c9d5731b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Creating volume 4633de5f-721c-45fc-8418-5ae7c8be838d {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:20:31 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:31 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d 1073741824 Sep 01 01:20:31 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63719eba-de57-4ada-a7cf-ea112314db61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88461442-85c4-4b34-bf48-6beb1c011031', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d9b754-fe08-424c-821f-8f781ddcdb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:31 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Volume volume-88461442-85c4-4b34-bf48-6beb1c011031 (88461442-85c4-4b34-bf48-6beb1c011031): created successfully Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d9b754-fe08-424c-821f-8f781ddcdb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Flow 'volume_create_manager' (2912ea40-9741-441a-a5e4-34e0cd5ade65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:31 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3667cbff-1555-422f-ae50-b18ecd4d78ca tempest-CreateVolumesFromImageTest-1421330993 None] Created volume successfully. Sep 01 01:20:32 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d 1073741824" returned: 0 in 0.478s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:32 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d Sep 01 01:20:32 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:32 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d" returned: 0 in 0.286s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.525s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104049474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1f59ae-c3a1-421c-af41-af063fe18c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350f470b6bfd4e98adb25cb4e5041176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:31Z,use_quota=True,user_id='0d8a74f95dc74033a3ce05c9d5731b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Creating volume 4e1f59ae-c3a1-421c-af41-af063fe18c87 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:20:32 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:32 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87 1073741824 Sep 01 01:20:32 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38daffe4-ef5d-45a0-aeca-880030504a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4633de5f-721c-45fc-8418-5ae7c8be838d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ff19c4-493b-4cdb-a5be-589652cb229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:32 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Volume volume-4633de5f-721c-45fc-8418-5ae7c8be838d (4633de5f-721c-45fc-8418-5ae7c8be838d): created successfully Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ff19c4-493b-4cdb-a5be-589652cb229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Flow 'volume_create_manager' (648eaeb6-8c30-4f7c-bf54-325574f6d598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:32 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-eed86b02-2d2f-488e-944a-c28f87fa19a0 tempest-CreateVolumesFromImageTest-1421330993 None] Created volume successfully. Sep 01 01:20:32 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87 1073741824" returned: 0 in 0.477s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:33 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87 Sep 01 01:20:33 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:33 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87" returned: 0 in 0.274s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.904s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1604483772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e90ec3-9adb-4f33-a631-dbc0607acffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350f470b6bfd4e98adb25cb4e5041176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:31Z,use_quota=True,user_id='0d8a74f95dc74033a3ce05c9d5731b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Creating volume 39e90ec3-9adb-4f33-a631-dbc0607acffd {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:20:33 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:33 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd 1073741824 Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d977a3ec-dab6-45b6-8348-c5ca402bd6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1f59ae-c3a1-421c-af41-af063fe18c87', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:33 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7b6f56-c7c8-4ea1-96a5-4363b0aaf248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:33 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Volume volume-4e1f59ae-c3a1-421c-af41-af063fe18c87 (4e1f59ae-c3a1-421c-af41-af063fe18c87): created successfully Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7b6f56-c7c8-4ea1-96a5-4363b0aaf248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Flow 'volume_create_manager' (abdfea0f-c605-4fc5-a367-482b81f17c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:33 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-06093a93-ad79-4d8e-b480-d3b3c9707dd4 tempest-CreateVolumesFromImageTest-1421330993 None] Created volume successfully. Sep 01 01:20:33 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd 1073741824" returned: 0 in 0.525s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:33 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd Sep 01 01:20:33 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:34 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd" returned: 0 in 0.257s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f646304-c4bc-482d-9c54-00842891b380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e90ec3-9adb-4f33-a631-dbc0607acffd', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fdca2a-bc2b-48de-a5e3-b5288028ad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:34 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Volume volume-39e90ec3-9adb-4f33-a631-dbc0607acffd (39e90ec3-9adb-4f33-a631-dbc0607acffd): created successfully Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fdca2a-bc2b-48de-a5e3-b5288028ad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Flow 'volume_create_manager' (e54ff30f-a9b8-4e6c-ae29-135041383594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-25f04b25-035e-461a-b9df-85670ef023b1 tempest-CreateVolumesFromImageTest-1421330993 None] Created volume successfully. Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "cinder-39e90ec3-9adb-4f33-a631-dbc0607acffd-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-39e90ec3-9adb-4f33-a631-dbc0607acffd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "cinder-quobyte-39e90ec3-9adb-4f33-a631-dbc0607acffd" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-quobyte-39e90ec3-9adb-4f33-a631-dbc0607acffd" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[151cbeeb-046f-4492-906c-822fe2b4d9e4]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:34 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd Sep 01 01:20:34 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:35 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd" returned: 0 in 0.488s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:35 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd Sep 01 01:20:35 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:35 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39e90ec3-9adb-4f33-a631-dbc0607acffd" returned: 0 in 0.259s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-quobyte-39e90ec3-9adb-4f33-a631-dbc0607acffd" released by "delete_volume" :: held 0.788s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Created reservations ['4934540a-36ed-4bb5-a3f5-3b0bb6c3d961', 'b417d6f3-aaf4-4c7a-98a7-fc7eba145f9c', '46133240-e361-430b-8b8d-f3c8d423fc18', 'a9ed0162-a5cc-4180-a8c7-dfde9ce453bb'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:35 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:20:35 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "cinder-4e1f59ae-c3a1-421c-af41-af063fe18c87-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-4e1f59ae-c3a1-421c-af41-af063fe18c87-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "cinder-quobyte-4e1f59ae-c3a1-421c-af41-af063fe18c87" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-quobyte-4e1f59ae-c3a1-421c-af41-af063fe18c87" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:36 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.319s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:20:36 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Deleted volume successfully. Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3fea65-f767-4fce-a08d-31e9c6207983]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1e7a3cdb-ab4f-44ba-b59c-fa2593092d14 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-39e90ec3-9adb-4f33-a631-dbc0607acffd-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:36 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87 Sep 01 01:20:36 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:36 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87" returned: 0 in 0.394s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:36 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87 Sep 01 01:20:36 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:36 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4e1f59ae-c3a1-421c-af41-af063fe18c87" returned: 0 in 0.262s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-quobyte-4e1f59ae-c3a1-421c-af41-af063fe18c87" released by "delete_volume" :: held 0.711s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Created reservations ['2bab317c-4a1e-47d6-9b8b-051049de0534', '62854617-8da4-4609-be85-7537f18a9531', '3b3a40df-a5bd-4ab9-b954-948d3f75feef', 'fc2c2542-f283-408f-9344-e0fe529378f1'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:36 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:20:36 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "cinder-4633de5f-721c-45fc-8418-5ae7c8be838d-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-4633de5f-721c-45fc-8418-5ae7c8be838d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "cinder-quobyte-4633de5f-721c-45fc-8418-5ae7c8be838d" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:37 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.346s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-quobyte-4633de5f-721c-45fc-8418-5ae7c8be838d" acquired by "delete_volume" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:37 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Deleted volume successfully. Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cbf7c7db-6706-4abb-bea0-b6e1c0dd15ab tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-4e1f59ae-c3a1-421c-af41-af063fe18c87-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc54d734-d61b-40d4-8de5-9420d946c853]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:37 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d Sep 01 01:20:37 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:37 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d" returned: 0 in 0.370s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:37 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d Sep 01 01:20:37 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:37 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4633de5f-721c-45fc-8418-5ae7c8be838d" returned: 0 in 0.268s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-quobyte-4633de5f-721c-45fc-8418-5ae7c8be838d" released by "delete_volume" :: held 0.694s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Created reservations ['40a0cb27-10cf-49f6-95c6-85d4f2f87320', '0f914706-aae5-4982-90df-4c653e290e93', '5d56eb21-9500-43ff-9a0a-a4de24d32c95', '3b11e963-8fac-4c11-a0ab-68655abe276c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:38 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:20:38 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:38 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.264s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "cinder-88461442-85c4-4b34-bf48-6beb1c011031-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:38 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Deleted volume successfully. Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-88461442-85c4-4b34-bf48-6beb1c011031-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9194fff9-c70c-481d-85fc-47b09d471bb3 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-4633de5f-721c-45fc-8418-5ae7c8be838d-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "cinder-quobyte-88461442-85c4-4b34-bf48-6beb1c011031" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-quobyte-88461442-85c4-4b34-bf48-6beb1c011031" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c5b56d-2dac-4f3c-971e-f30e3dc1bf60]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:38 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031 Sep 01 01:20:38 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:38 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031" returned: 0 in 0.410s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:39 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031 Sep 01 01:20:39 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:39 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-88461442-85c4-4b34-bf48-6beb1c011031" returned: 0 in 0.295s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-quobyte-88461442-85c4-4b34-bf48-6beb1c011031" released by "delete_volume" :: held 0.779s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Created reservations ['10602572-d9fc-452b-bbd1-fa7ac2b1027f', 'a6cd64a6-02e7-41f7-bb8a-46d4eff30f7d', '7e71ed6f-0f7c-4cc8-89e1-e7b748d97dee', '5a820162-8c5d-4102-a490-7d430195ab69'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:39 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:20:39 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "cinder-b60f012a-ae67-4b47-98ec-c9993debf413-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-b60f012a-ae67-4b47-98ec-c9993debf413-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "cinder-quobyte-b60f012a-ae67-4b47-98ec-c9993debf413" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-quobyte-b60f012a-ae67-4b47-98ec-c9993debf413" acquired by "delete_volume" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:39 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.325s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:20:39 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Deleted volume successfully. Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf545f-939c-4dd2-a005-13cfa1f821fc]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7d412b78-88ba-489e-8e23-6a4a58b3b23c tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-88461442-85c4-4b34-bf48-6beb1c011031-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:39 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413 Sep 01 01:20:39 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:40 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413" returned: 0 in 0.384s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:40 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413 Sep 01 01:20:40 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:40 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-b60f012a-ae67-4b47-98ec-c9993debf413" returned: 0 in 0.319s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-quobyte-b60f012a-ae67-4b47-98ec-c9993debf413" released by "delete_volume" :: held 0.758s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Created reservations ['594b19e1-e777-499a-9909-6c1ca8c6ddda', 'f41de2b8-1639-4336-bc54-687d2a233e6d', 'cd707365-1e71-450a-a540-6619ca611140', '4d0e8f9c-6bf5-4e93-babc-aafd7998ebaa'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:40 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:20:40 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:40 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.284s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:20:40 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Deleted volume successfully. Sep 01 01:20:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-cff38037-7102-4821-91b2-a0280a2cbc85 tempest-CreateVolumesFromImageTest-1421330993 None] Lock "cinder-b60f012a-ae67-4b47-98ec-c9993debf413-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:46 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:20:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Flow 'volume_create_manager' (3b1c09f0-eefd-4d34-b44f-9e7198c2a96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1fe359-f304-4d35-9a3e-e263605adf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1fe359-f304-4d35-9a3e-e263605adf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f027e3a-9114-4b8d-af8c-3e73080b63d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b76fafdae4860a6e444e0cd369716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:47Z,use_quota=True,user_id='edcfcab7d98847a0a9737977e5e5c89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d690c24-d626-45ad-8cd2-9e53c8032778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d690c24-d626-45ad-8cd2-9e53c8032778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4ac72e-b9c2-46ed-8d7d-b39a3ce69ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:46 devstack cinder-volume[87064]: DEBUG cinder.image.glance [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Creating Keystone auth plugin from conf {{(pid=87064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:20:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4ac72e-b9c2-46ed-8d7d-b39a3ce69ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f027e3a-9114-4b8d-af8c-3e73080b63d3', 'volume_name': 'volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3', 'volume_size': 1, 'image_id': '073c1595-ac42-4a53-972c-b93cdb98b553', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/073c1595-ac42-4a53-972c-b93cdb98b553', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30334a3994f0c9a2d07bd27bfa242bbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff8b76fafdae4860a6e444e0cd369716', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b419a877a06ab6d7c74e83a6068d46a7e2afab6ebcad650912ce045180e3a2c3400fb7607d3d0e6eb8ddd90df43fd14ca35573115f320b5b146cd43c23f6f1c', 'id': '073c1595-ac42-4a53-972c-b93cdb98b553', 'created_at': datetime.datetime(2026, 8, 31, 23, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/073c1595-ac42-4a53-972c-b93cdb98b553/file', 'properties': {}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b9af78-61b3-48fe-a6f0-26dfbb823840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b9af78-61b3-48fe-a6f0-26dfbb823840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06f7c15-7b8f-4966-945c-a687e16ed570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:47 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Volume 3f027e3a-9114-4b8d-af8c-3e73080b63d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3', 'volume_size': 1, 'image_id': '073c1595-ac42-4a53-972c-b93cdb98b553', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/073c1595-ac42-4a53-972c-b93cdb98b553', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30334a3994f0c9a2d07bd27bfa242bbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff8b76fafdae4860a6e444e0cd369716', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b419a877a06ab6d7c74e83a6068d46a7e2afab6ebcad650912ce045180e3a2c3400fb7607d3d0e6eb8ddd90df43fd14ca35573115f320b5b146cd43c23f6f1c', 'id': '073c1595-ac42-4a53-972c-b93cdb98b553', 'created_at': datetime.datetime(2026, 8, 31, 23, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/073c1595-ac42-4a53-972c-b93cdb98b553/file', 'properties': {}}, 'image_service': } Sep 01 01:20:47 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Trying to clone 3f027e3a-9114-4b8d-af8c-3e73080b63d3 from image 073c1595-ac42-4a53-972c-b93cdb98b553 at location (None, [{'url': 'file:///opt/stack/data/glance/images/073c1595-ac42-4a53-972c-b93cdb98b553', 'metadata': {}}]). {{(pid=87064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:20:47 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:20:47 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Image download 0.00 MB at 0.00 MB/s Sep 01 01:20:47 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6ee940-5b14-4139-b239-12358cdac808]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:47 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD Sep 01 01:20:47 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:47 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:48 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD Sep 01 01:20:48 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:48 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:20:48 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Temporary image 073c1595-ac42-4a53-972c-b93cdb98b553 is fetched for user edcfcab7d98847a0a9737977e5e5c89e. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:20:48 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6151b9-69bc-44be-911b-f79d4bf154a1]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:48 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD Sep 01 01:20:48 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:48 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:48 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD Sep 01 01:20:48 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:49 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD" returned: 1 in 0.360s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f027e3a-9114-4b8d-af8c-3e73080b63d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8b76fafdae4860a6e444e0cd369716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:20:47Z,use_quota=True,user_id='edcfcab7d98847a0a9737977e5e5c89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Creating volume 3f027e3a-9114-4b8d-af8c-3e73080b63d3 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:20:49 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:49 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 1073741824 Sep 01 01:20:49 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:49 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 1073741824" returned: 0 in 0.517s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:49 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 Sep 01 01:20:49 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:49 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3" returned: 0 in 0.287s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:49 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Attempting download of 073c1595-ac42-4a53-972c-b93cdb98b553 ((None, [{'url': 'file:///opt/stack/data/glance/images/073c1595-ac42-4a53-972c-b93cdb98b553', 'metadata': {}}])) to volume 3f027e3a-9114-4b8d-af8c-3e73080b63d3. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:20:50 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0cd830-227e-4df4-9359-c834c9ff6370]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_073c1595-ac42-4a53-972c-b93cdb98b553_cmhz7s9h {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:50 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_073c1595-ac42-4a53-972c-b93cdb98b553_cmhz7s9h Sep 01 01:20:50 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:50 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_073c1595-ac42-4a53-972c-b93cdb98b553_cmhz7s9h" returned: 0 in 0.340s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_073c1595-ac42-4a53-972c-b93cdb98b553_cmhz7s9h {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:50 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_073c1595-ac42-4a53-972c-b93cdb98b553_cmhz7s9h Sep 01 01:20:50 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:50 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_073c1595-ac42-4a53-972c-b93cdb98b553_cmhz7s9h" returned: 1 in 0.343s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_073c1595-ac42-4a53-972c-b93cdb98b553_cmhz7s9h' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:20:50 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92e8fcf-bda5-42b6-afe8-f3f185297ff3]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:50 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD Sep 01 01:20:50 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:51 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:51 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD Sep 01 01:20:51 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:51 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:20:51 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] 073c1595-ac42-4a53-972c-b93cdb98b553 was raw, converting to qcow2 {{(pid=87064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:20:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:51 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 Sep 01 01:20:51 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:52 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3" returned: 0 in 0.575s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_073c1595-ac42-4a53-972c-b93cdb98b553_dvae2d41devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:20:52 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:52 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 1G Sep 01 01:20:52 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:52 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 1G" returned: 0 in 0.345s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Downloaded image 073c1595-ac42-4a53-972c-b93cdb98b553 ((None, [{'url': 'file:///opt/stack/data/glance/images/073c1595-ac42-4a53-972c-b93cdb98b553', 'metadata': {}}])) to volume 3f027e3a-9114-4b8d-af8c-3e73080b63d3 successfully. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Temporary image 073c1595-ac42-4a53-972c-b93cdb98b553 for user edcfcab7d98847a0a9737977e5e5c89e is deleted. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Marking volume 3f027e3a-9114-4b8d-af8c-3e73080b63d3 as bootable. {{(pid=87064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Copying metadata from image 073c1595-ac42-4a53-972c-b93cdb98b553 to 3f027e3a-9114-4b8d-af8c-3e73080b63d3. {{(pid=87064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Creating volume glance metadata for volume 3f027e3a-9114-4b8d-af8c-3e73080b63d3 backed by image 073c1595-ac42-4a53-972c-b93cdb98b553 with: {'image_id': '073c1595-ac42-4a53-972c-b93cdb98b553', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '30334a3994f0c9a2d07bd27bfa242bbf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06f7c15-7b8f-4966-945c-a687e16ed570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3', 'volume_size': 1, 'image_id': '073c1595-ac42-4a53-972c-b93cdb98b553', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/073c1595-ac42-4a53-972c-b93cdb98b553', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30334a3994f0c9a2d07bd27bfa242bbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff8b76fafdae4860a6e444e0cd369716', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b419a877a06ab6d7c74e83a6068d46a7e2afab6ebcad650912ce045180e3a2c3400fb7607d3d0e6eb8ddd90df43fd14ca35573115f320b5b146cd43c23f6f1c', 'id': '073c1595-ac42-4a53-972c-b93cdb98b553', 'created_at': datetime.datetime(2026, 8, 31, 23, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/073c1595-ac42-4a53-972c-b93cdb98b553/file', 'properties': {}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62d2b81-d57c-434c-b37b-8480b28aa475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:20:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Volume volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 (3f027e3a-9114-4b8d-af8c-3e73080b63d3): created successfully Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62d2b81-d57c-434c-b37b-8480b28aa475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Flow 'volume_create_manager' (3b1c09f0-eefd-4d34-b44f-9e7198c2a96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:20:52 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-393f0086-55f2-450a-b39c-721e4c243c19 tempest-VolumeImageDependencyTests-1889223233 None] Created volume successfully. Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:52 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:20:52 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:52 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.251s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:20:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:20:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Acquiring lock "cinder-3f027e3a-9114-4b8d-af8c-3e73080b63d3-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Lock "cinder-3f027e3a-9114-4b8d-af8c-3e73080b63d3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:53 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=80,cinder:UPDATE=95,cinder:INSERT=25,cinder:DELETE=10 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:20:53 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=85,cinder:UPDATE=88,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:20:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Acquiring lock "cinder-quobyte-3f027e3a-9114-4b8d-af8c-3e73080b63d3" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:20:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Lock "cinder-quobyte-3f027e3a-9114-4b8d-af8c-3e73080b63d3" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:20:53 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00c229e-385d-4136-8502-ceb9baf995af]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:20:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:53 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 Sep 01 01:20:53 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:53 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3" returned: 0 in 0.398s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:53 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3 Sep 01 01:20:53 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:54 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3f027e3a-9114-4b8d-af8c-3e73080b63d3" returned: 0 in 0.268s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Lock "cinder-quobyte-3f027e3a-9114-4b8d-af8c-3e73080b63d3" released by "delete_volume" :: held 0.712s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Created reservations ['bf13078a-31e1-4561-8dc2-0db6cbc074da', '516920d9-79fe-4840-a2ea-d13169b37fb5', '16a2abd3-2f0d-4f2f-b5a5-c5fe78b74be5', '66589329-1e25-41ac-a612-2d04bae127fe'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:20:54 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:20:54 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:20:54 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.316s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:20:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Deleted volume successfully. Sep 01 01:20:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f9c8243a-013b-472d-a184-ae5b3d3b3bef tempest-VolumeImageDependencyTests-1889223233 None] Lock "cinder-3f027e3a-9114-4b8d-af8c-3e73080b63d3-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:21:04 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:21:04 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Flow 'volume_create_manager' (d689292f-b9fc-4f28-9d34-d5e6cf0e1109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58c7fef-dbaf-4ef5-a8b3-5b2f97837275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58c7fef-dbaf-4ef5-a8b3-5b2f97837275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1972567690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191112b8-2c21-4bc0-b7bc-7918b80239d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0092d78dd0c4426c942ffe07d572991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:21:09Z,use_quota=True,user_id='8bddc94904cd4df69d4a3c70862a4385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d073da28-87d0-4aa9-aff7-7022788f1ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d073da28-87d0-4aa9-aff7-7022788f1ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe2f659-ed3b-4354-ac8d-d80bc428be51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe2f659-ed3b-4354-ac8d-d80bc428be51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191112b8-2c21-4bc0-b7bc-7918b80239d7', 'volume_name': 'volume-191112b8-2c21-4bc0-b7bc-7918b80239d7', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6986a7-e37d-4c7e-b638-886a8bae2964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6986a7-e37d-4c7e-b638-886a8bae2964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711bb183-798e-4247-b02d-f7f30924069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:21:08 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Volume 191112b8-2c21-4bc0-b7bc-7918b80239d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191112b8-2c21-4bc0-b7bc-7918b80239d7', 'volume_size': 1} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1972567690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191112b8-2c21-4bc0-b7bc-7918b80239d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0092d78dd0c4426c942ffe07d572991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:21:09Z,use_quota=True,user_id='8bddc94904cd4df69d4a3c70862a4385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Creating volume 191112b8-2c21-4bc0-b7bc-7918b80239d7 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:21:08 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:21:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:08 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 1073741824 Sep 01 01:21:08 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:21:09 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 01 01:21:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 1073741824" returned: 0 in 0.465s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:21:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:09 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 Sep 01 01:21:09 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:21:09 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 01 01:21:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7" returned: 0 in 0.277s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:21:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:21:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:21:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711bb183-798e-4247-b02d-f7f30924069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191112b8-2c21-4bc0-b7bc-7918b80239d7', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:21:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e98c7ee-b991-42a4-a196-29ec3bb853e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:21:09 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Volume volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 (191112b8-2c21-4bc0-b7bc-7918b80239d7): created successfully Sep 01 01:21:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e98c7ee-b991-42a4-a196-29ec3bb853e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:21:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Flow 'volume_create_manager' (d689292f-b9fc-4f28-9d34-d5e6cf0e1109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:21:09 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0f683295-ca51-4687-aebf-429bb7206928 tempest-TestStampPattern-1443698937 None] Created volume successfully. Sep 01 01:21:19 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:21:19 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:21:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-79ccfd91-d25a-4906-b968-b3fa434d317f req-ead81864-e8e7-4393-bca3-24a7201011b1 tempest-TestStampPattern-1443698937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:21:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-79ccfd91-d25a-4906-b968-b3fa434d317f req-ead81864-e8e7-4393-bca3-24a7201011b1 tempest-TestStampPattern-1443698937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:21:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-79ccfd91-d25a-4906-b968-b3fa434d317f req-ead81864-e8e7-4393-bca3-24a7201011b1 tempest-TestStampPattern-1443698937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:21:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-79ccfd91-d25a-4906-b968-b3fa434d317f req-ead81864-e8e7-4393-bca3-24a7201011b1 tempest-TestStampPattern-1443698937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-191112b8-2c21-4bc0-b7bc-7918b80239d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4a2942f-9055-45e9-98ae-8a56e3bfc986', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:21:39 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-79ccfd91-d25a-4906-b968-b3fa434d317f req-ead81864-e8e7-4393-bca3-24a7201011b1 tempest-TestStampPattern-1443698937 None] attachment_update completed successfully. Sep 01 01:21:43 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-faf22333-2b93-4166-af6f-2e1d3fd1ce74 req-8c2ba224-ad86-4828-89f1-2cfddb3d7686 tempest-TestStampPattern-1443698937 None] Terminate volume connection completed successfully. Sep 01 01:21:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-faf22333-2b93-4166-af6f-2e1d3fd1ce74 req-8c2ba224-ad86-4828-89f1-2cfddb3d7686 tempest-TestStampPattern-1443698937 None] Deleting attachment e4a2942f-9055-45e9-98ae-8a56e3bfc986. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:21:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:21:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:21:44 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] Creating offline snapshot 954d67f7-707f-4500-ad17-4404c2d3ba29 of volume 191112b8-2c21-4bc0-b7bc-7918b80239d7 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:21:44 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d60bc85-2283-4ee0-af9d-0a83b31dc050]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:21:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:44 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 Sep 01 01:21:44 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:21:44 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 01 01:21:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7" returned: 0 in 0.406s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:21:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:44 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 1G Sep 01 01:21:44 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:21:45 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 01 01:21:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 1G" returned: 0 in 0.423s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:21:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:45 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 Sep 01 01:21:45 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:21:45 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 01 01:21:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29" returned: 0 in 0.316s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:21:45 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 is being set with open permissions: ugo+rw Sep 01 01:21:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:45 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 Sep 01 01:21:45 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:21:45 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 01 01:21:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29" returned: 0 in 0.254s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:21:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:45 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.info Sep 01 01:21:45 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:21:46 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 01 01:21:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.info" returned: 0 in 0.273s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:21:46 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.info is being set with open permissions: ugo+rw Sep 01 01:21:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:46 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.info Sep 01 01:21:46 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:21:46 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Sep 01 01:21:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.info" returned: 0 in 0.241s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:21:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:21:46 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b95c76d1-a919-4bee-b343-2ac3737a422f tempest-TestStampPattern-1443698937 None] Create snapshot completed successfully Sep 01 01:21:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:21:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:21:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:21:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:21:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:21:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:21:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:52 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:21:52 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:21:53 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Sep 01 01:21:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.322s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:21:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:21:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:21:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:21:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Flow 'volume_create_manager' (71f0a8bf-cd85-4a8a-a548-0f0b36c4c0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586234eb-d974-47a6-9aa6-798e4f646407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586234eb-d974-47a6-9aa6-798e4f646407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1542043996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a961b66-28c5-474f-8e81-b165a4419c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0092d78dd0c4426c942ffe07d572991b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=954d67f7-707f-4500-ad17-4404c2d3ba29,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:21:54Z,use_quota=True,user_id='8bddc94904cd4df69d4a3c70862a4385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ee44b7-0b00-4870-a8d3-323b52fbcd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ee44b7-0b00-4870-a8d3-323b52fbcd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd10d551-f669-4ced-89f0-39a382985931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd10d551-f669-4ced-89f0-39a382985931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5a961b66-28c5-474f-8e81-b165a4419c23', 'volume_name': 'volume-5a961b66-28c5-474f-8e81-b165a4419c23', 'volume_size': 1, 'snapshot_id': '954d67f7-707f-4500-ad17-4404c2d3ba29'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983d2925-68b2-4186-9eba-38c4996308b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983d2925-68b2-4186-9eba-38c4996308b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e88a4c-de56-4fb4-b632-a84122e779d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:21:54 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Volume 5a961b66-28c5-474f-8e81-b165a4419c23: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5a961b66-28c5-474f-8e81-b165a4419c23', 'volume_size': 1, 'snapshot_id': '954d67f7-707f-4500-ad17-4404c2d3ba29'} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Acquiring lock "cinder-quobyte-954d67f7-707f-4500-ad17-4404c2d3ba29-5a961b66-28c5-474f-8e81-b165a4419c23" by "_create_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-954d67f7-707f-4500-ad17-4404c2d3ba29-5a961b66-28c5-474f-8e81-b165a4419c23" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Creating volume 5a961b66-28c5-474f-8e81-b165a4419c23 from snapshot 954d67f7-707f-4500-ad17-4404c2d3ba29 {{(pid=87064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Acquiring lock "cinder-quobyte-5a961b66-28c5-474f-8e81-b165a4419c23" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-5a961b66-28c5-474f-8e81-b165a4419c23" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] snapshot: 954d67f7-707f-4500-ad17-4404c2d3ba29, volume: 5a961b66-28c5-474f-8e81-b165a4419c23, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9500544e-12c4-4b8c-a694-bffc713e9f53]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:54 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 Sep 01 01:21:54 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:21:54 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29" returned: 0 in 0.422s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-191112b8-2c21-4bc0-b7bc-7918b80239d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c04d804-e2dd-4f90-b580-e868170f914f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:21:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:55 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 Sep 01 01:21:55 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:21:55 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 01 01:21:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7" returned: 0 in 0.478s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:21:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:21:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:21:55 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23 not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:21:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:21:55 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23 Sep 01 01:21:55 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:22:01 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 01 01:22:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23" returned: 0 in 5.898s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:22:01 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:22:01 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Converted 1024.00 MB image at 173.48 MB/s Sep 01 01:22:01 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23 is being set with open permissions: ugo+rw Sep 01 01:22:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:22:01 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23 Sep 01 01:22:01 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:22:01 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 01 01:22:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23" returned: 0 in 0.370s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:22:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-5a961b66-28c5-474f-8e81-b165a4419c23" released by "_copy_volume_from_snapshot" :: held 7.273s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:22:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-954d67f7-707f-4500-ad17-4404c2d3ba29-5a961b66-28c5-474f-8e81-b165a4419c23" released by "_create_volume_from_snapshot" :: held 7.395s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:22:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.415s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:22:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e88a4c-de56-4fb4-b632-a84122e779d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a961b66-28c5-474f-8e81-b165a4419c23', 'volume_size': 1, 'snapshot_id': '954d67f7-707f-4500-ad17-4404c2d3ba29'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:22:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a68ee34-1763-4a4c-8fcc-8137d36f50b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:22:01 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Volume volume-5a961b66-28c5-474f-8e81-b165a4419c23 (5a961b66-28c5-474f-8e81-b165a4419c23): created successfully Sep 01 01:22:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a68ee34-1763-4a4c-8fcc-8137d36f50b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:22:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Flow 'volume_create_manager' (71f0a8bf-cd85-4a8a-a548-0f0b36c4c0e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:22:01 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b0cab4aa-ec5a-48cb-a1ed-8450d9449949 tempest-TestStampPattern-1443698937 None] Created volume successfully. Sep 01 01:22:11 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=17,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:22:11 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=13,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:22:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ad0aa479-4b3b-470a-af90-a7414a02a3a0 req-fc0d6b3d-1e0c-4447-b27d-0781473a86fd tempest-TestStampPattern-1443698937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:22:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ad0aa479-4b3b-470a-af90-a7414a02a3a0 req-fc0d6b3d-1e0c-4447-b27d-0781473a86fd tempest-TestStampPattern-1443698937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:22:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [req-ad0aa479-4b3b-470a-af90-a7414a02a3a0 req-fc0d6b3d-1e0c-4447-b27d-0781473a86fd tempest-TestStampPattern-1443698937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:22:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-ad0aa479-4b3b-470a-af90-a7414a02a3a0 req-fc0d6b3d-1e0c-4447-b27d-0781473a86fd tempest-TestStampPattern-1443698937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52', 'name': 'volume-5a961b66-28c5-474f-8e81-b165a4419c23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41e031b5-b16c-405f-96a9-9ff02163c5ac', 'enforce_multipath': True} {{(pid=87064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:22:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-ad0aa479-4b3b-470a-af90-a7414a02a3a0 req-fc0d6b3d-1e0c-4447-b27d-0781473a86fd tempest-TestStampPattern-1443698937 None] attachment_update completed successfully. Sep 01 01:22:49 devstack cinder-volume[87064]: INFO cinder.volume.manager [req-6b8051d1-b939-4d57-8770-edb4b73a44f8 req-2c628d91-9884-4b29-847a-afd708451c99 tempest-TestStampPattern-1443698937 None] Terminate volume connection completed successfully. Sep 01 01:22:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [req-6b8051d1-b939-4d57-8770-edb4b73a44f8 req-2c628d91-9884-4b29-847a-afd708451c99 tempest-TestStampPattern-1443698937 None] Deleting attachment 41e031b5-b16c-405f-96a9-9ff02163c5ac. {{(pid=87064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:22:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:22:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:22:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:22:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:22:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:22:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:22:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:22:52 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:22:52 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:22:52 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 01 01:22:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.293s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:22:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:22:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:22:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:22:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:22:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Acquiring lock "cinder-5a961b66-28c5-474f-8e81-b165a4419c23-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:22:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Lock "cinder-5a961b66-28c5-474f-8e81-b165a4419c23-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:22:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Acquiring lock "cinder-quobyte-5a961b66-28c5-474f-8e81-b165a4419c23" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:22:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-5a961b66-28c5-474f-8e81-b165a4419c23" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:22:53 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bb2dc3-f072-4fb2-936b-782ef79caa51]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:22:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:22:54 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23 Sep 01 01:22:54 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:22:54 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 01 01:22:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23" returned: 0 in 0.384s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:22:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:22:54 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23 Sep 01 01:22:54 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:22:54 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 01 01:22:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-5a961b66-28c5-474f-8e81-b165a4419c23" returned: 0 in 0.304s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:22:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-5a961b66-28c5-474f-8e81-b165a4419c23" released by "delete_volume" :: held 0.733s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:22:54 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Created reservations ['21ae18c0-9f0a-409d-9ead-ce1316cd5195', '88df9d64-c14b-4407-8536-019384c5fcc3', '72906564-78b6-419c-9dad-598743d7cc77', '6eb8b027-4e34-4aba-bfc2-512b502ed29f'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:22:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:22:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:22:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:22:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:22:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:22:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:22:54 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:22:54 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:22:55 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.319s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:22:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Deleted volume successfully. Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c716f132-7322-4602-b391-451102cc1ecb tempest-TestStampPattern-1443698937 None] Lock "cinder-5a961b66-28c5-474f-8e81-b165a4419c23-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Acquiring lock "cinder-954d67f7-707f-4500-ad17-4404c2d3ba29-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Lock "cinder-954d67f7-707f-4500-ad17-4404c2d3ba29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Acquiring lock "cinder-quobyte-191112b8-2c21-4bc0-b7bc-7918b80239d7" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-191112b8-2c21-4bc0-b7bc-7918b80239d7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Acquiring lock "cinder-quobyte-954d67f7-707f-4500-ad17-4404c2d3ba29" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-954d67f7-707f-4500-ad17-4404c2d3ba29" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Deleting offline snapshot 954d67f7-707f-4500-ad17-4404c2d3ba29 of volume 191112b8-2c21-4bc0-b7bc-7918b80239d7 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] snapshot_file for this snap is: volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[49154358-a450-4b19-818d-07dfca9314ed]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:22:55 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 Sep 01 01:22:55 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:22:55 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29" returned: 0 in 0.399s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-191112b8-2c21-4bc0-b7bc-7918b80239d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4bffb8-ad21-43e6-b96e-6ed261fb365c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:22:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:22:56 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 Sep 01 01:22:56 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:22:56 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 01 01:22:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7" returned: 0 in 0.543s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:22:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:22:56 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 Sep 01 01:22:56 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:22:56 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 01 01:22:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29" returned: 0 in 0.415s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:22:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:22:56 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29 Sep 01 01:22:56 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:22:57 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 01 01:22:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7.954d67f7-707f-4500-ad17-4404c2d3ba29" returned: 0 in 0.269s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:22:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-954d67f7-707f-4500-ad17-4404c2d3ba29" released by "_delete_snapshot" :: held 1.732s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:22:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-191112b8-2c21-4bc0-b7bc-7918b80239d7" released by "delete_snapshot" :: held 1.799s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:22:57 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Created reservations ['81652d71-185a-4c3c-8026-e2d4c0fc62be', '04524c5d-b3d0-4589-acad-a1ad8d131aa5', '2e8450ba-6b4b-4fd2-a05e-3cbed8e23f16', '2835e242-ff50-47c7-81dc-bd768f101b21'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:22:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Delete snapshot completed successfully. Sep 01 01:22:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5a8edc01-6c60-4136-a647-d73b9e3561c0 tempest-TestStampPattern-1443698937 None] Lock "cinder-954d67f7-707f-4500-ad17-4404c2d3ba29-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Acquiring lock "cinder-191112b8-2c21-4bc0-b7bc-7918b80239d7-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Lock "cinder-191112b8-2c21-4bc0-b7bc-7918b80239d7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Acquiring lock "cinder-quobyte-191112b8-2c21-4bc0-b7bc-7918b80239d7" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-191112b8-2c21-4bc0-b7bc-7918b80239d7" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8c912d-d5d4-46f4-820d-29eabf1dcce8]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:01 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 Sep 01 01:23:01 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:01 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7" returned: 0 in 0.415s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:01 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7 Sep 01 01:23:01 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:02 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-191112b8-2c21-4bc0-b7bc-7918b80239d7" returned: 0 in 0.256s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Lock "cinder-quobyte-191112b8-2c21-4bc0-b7bc-7918b80239d7" released by "delete_volume" :: held 0.734s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Created reservations ['59009d45-3f24-4cfa-b435-49f6fcdd45f3', '80d5d5e0-860a-401b-896a-b789f7f5fd2a', '473bbd7a-f107-4e33-8dbc-d75275eba610', 'f5f2dc63-25c1-4089-8f7e-5fe0fbdd8887'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:02 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:23:02 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:02 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.264s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:23:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Deleted volume successfully. Sep 01 01:23:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-38a990a9-9702-4409-af0f-af7ce4856402 tempest-TestStampPattern-1443698937 None] Lock "cinder-191112b8-2c21-4bc0-b7bc-7918b80239d7-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:12 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:23:12 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=26,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:23:15 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:23:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (ad6cfc71-2438-408d-8008-d49957c5983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94b5188-4c88-41ed-adc4-4d330b73cc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94b5188-4c88-41ed-adc4-4d330b73cc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-488358691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df567bb-099d-4eaa-98b2-711644bc6c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:16Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befed46e-b30a-4682-976b-0f0160459e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befed46e-b30a-4682-976b-0f0160459e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124607e7-d1bc-4a15-85cc-a5c1281639d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124607e7-d1bc-4a15-85cc-a5c1281639d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df567bb-099d-4eaa-98b2-711644bc6c48', 'volume_name': 'volume-4df567bb-099d-4eaa-98b2-711644bc6c48', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545ffa42-08aa-4ad5-8eb5-e2bd01a9b038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545ffa42-08aa-4ad5-8eb5-e2bd01a9b038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (442981c0-0f2a-41d0-b6c2-806148ea93e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:16 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume 4df567bb-099d-4eaa-98b2-711644bc6c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df567bb-099d-4eaa-98b2-711644bc6c48', 'volume_size': 1} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-488358691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df567bb-099d-4eaa-98b2-711644bc6c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:16Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Creating volume 4df567bb-099d-4eaa-98b2-711644bc6c48 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:23:16 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:16 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48 1073741824 Sep 01 01:23:16 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:16 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48 1073741824" returned: 0 in 0.471s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:16 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48 Sep 01 01:23:16 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:16 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48" returned: 0 in 0.290s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (442981c0-0f2a-41d0-b6c2-806148ea93e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df567bb-099d-4eaa-98b2-711644bc6c48', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07c3690-2cd3-47d6-8c0d-1a13c155ceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:16 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume volume-4df567bb-099d-4eaa-98b2-711644bc6c48 (4df567bb-099d-4eaa-98b2-711644bc6c48): created successfully Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07c3690-2cd3-47d6-8c0d-1a13c155ceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:16 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (ad6cfc71-2438-408d-8008-d49957c5983e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:16 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e0439871-bf72-4008-8458-c67e7980c0cc tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created volume successfully. Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (dc176493-bc6e-485b-af31-54aa743b1671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212b74a9-749c-422d-b19c-cc38d3f68b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212b74a9-749c-422d-b19c-cc38d3f68b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1080509552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03bfcf93-9281-479a-80a5-1c2efa714211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:18Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236328c5-057a-46f3-ac08-699844e10c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236328c5-057a-46f3-ac08-699844e10c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a3a425-734a-40c1-82f2-62455cbf0cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a3a425-734a-40c1-82f2-62455cbf0cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03bfcf93-9281-479a-80a5-1c2efa714211', 'volume_name': 'volume-03bfcf93-9281-479a-80a5-1c2efa714211', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e2c7bf-1c4b-4b16-acf6-1408aa88a822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e2c7bf-1c4b-4b16-acf6-1408aa88a822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28feafd5-5608-418c-ba87-525b27bb47ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:18 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume 03bfcf93-9281-479a-80a5-1c2efa714211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03bfcf93-9281-479a-80a5-1c2efa714211', 'volume_size': 1} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1080509552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03bfcf93-9281-479a-80a5-1c2efa714211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:18Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Creating volume 03bfcf93-9281-479a-80a5-1c2efa714211 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:23:18 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:18 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211 1073741824 Sep 01 01:23:18 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (d601449a-5e06-4c4c-9548-ddef8653d4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38da31de-6bdc-4a98-a6df-85143af1351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38da31de-6bdc-4a98-a6df-85143af1351e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-382295686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:19Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4e4880-b9d9-4d9c-a7a5-1c2f970fe5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4e4880-b9d9-4d9c-a7a5-1c2f970fe5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d7955e-c7e8-4b64-99d8-90435e70d344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d7955e-c7e8-4b64-99d8-90435e70d344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8', 'volume_name': 'volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefc68c0-75dd-4753-a4a0-2fcbc36bf9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefc68c0-75dd-4753-a4a0-2fcbc36bf9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9be0df-30ad-4ade-b292-4d873c4998fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:18 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8', 'volume_size': 1} Sep 01 01:23:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:19 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211 1073741824" returned: 0 in 0.561s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:19 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211 Sep 01 01:23:19 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (751214e8-1f34-43ae-88a0-b9910f8b05e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c5afa8-118a-4c7c-bc26-78183ddc2b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c5afa8-118a-4c7c-bc26-78183ddc2b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-232888739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299f565a-1efa-4ad2-b7b8-3d9b6b8b0370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:19Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f68e150-e4a8-47ff-8115-99954d6cd660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f68e150-e4a8-47ff-8115-99954d6cd660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ad68ef-90d6-4152-b46a-b333720cefbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ad68ef-90d6-4152-b46a-b333720cefbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299f565a-1efa-4ad2-b7b8-3d9b6b8b0370', 'volume_name': 'volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d259a24-1689-4ad8-99c4-49c6c5bb7159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d259a24-1689-4ad8-99c4-49c6c5bb7159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc183fc-65eb-4210-9c2f-96503893e816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:19 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume 299f565a-1efa-4ad2-b7b8-3d9b6b8b0370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370', 'volume_size': 1} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:19 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211" returned: 0 in 0.310s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.544s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-382295686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:19Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Creating volume ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:23:19 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28feafd5-5608-418c-ba87-525b27bb47ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03bfcf93-9281-479a-80a5-1c2efa714211', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:19 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8 1073741824 Sep 01 01:23:19 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698d5517-5f2a-484e-a8c0-42cef8d37d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:19 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume volume-03bfcf93-9281-479a-80a5-1c2efa714211 (03bfcf93-9281-479a-80a5-1c2efa714211): created successfully Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698d5517-5f2a-484e-a8c0-42cef8d37d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (dc176493-bc6e-485b-af31-54aa743b1671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:19 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-09776690-cdb8-4b93-924b-c8212cefb91f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created volume successfully. Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (f5db3d2a-1466-4129-8ebd-d572f4c100fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e45f76d-3650-4f24-b2d3-c08f515d139e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e45f76d-3650-4f24-b2d3-c08f515d139e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-758995659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3650e51-3c6e-4819-81c1-d3fb951dc985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:20Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe7f056-412e-4113-a5e7-f1c0628de845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe7f056-412e-4113-a5e7-f1c0628de845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0d9661-7719-4d0c-a7e1-a3a34fea66c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0d9661-7719-4d0c-a7e1-a3a34fea66c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3650e51-3c6e-4819-81c1-d3fb951dc985', 'volume_name': 'volume-f3650e51-3c6e-4819-81c1-d3fb951dc985', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac24fbb-1f23-41f7-a49e-91a9e2036672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac24fbb-1f23-41f7-a49e-91a9e2036672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b178ab-22ff-4e31-bc67-a68afe85bfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:19 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume f3650e51-3c6e-4819-81c1-d3fb951dc985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3650e51-3c6e-4819-81c1-d3fb951dc985', 'volume_size': 1} Sep 01 01:23:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:23:20 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (dea25224-18f7-4fea-9782-2f78b1ed1b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6399903-7024-4979-8314-f9688ac8bc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8 1073741824" returned: 0 in 0.664s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6399903-7024-4979-8314-f9688ac8bc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1321965901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d4080d-e78a-4291-b20e-c8749147ecf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:20Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ee3d50-3fcb-47b9-bd56-99d8f18d3b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ee3d50-3fcb-47b9-bd56-99d8f18d3b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af50e650-9422-441d-8fc5-e4cf79f5de0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af50e650-9422-441d-8fc5-e4cf79f5de0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d4080d-e78a-4291-b20e-c8749147ecf5', 'volume_name': 'volume-68d4080d-e78a-4291-b20e-c8749147ecf5', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a6413d-f823-4ec8-9bb0-e0053e763b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a6413d-f823-4ec8-9bb0-e0053e763b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b628e9-cbaa-454f-9d27-5be4ef1fbcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:20 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume 68d4080d-e78a-4291-b20e-c8749147ecf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d4080d-e78a-4291-b20e-c8749147ecf5', 'volume_size': 1} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:20 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8 Sep 01 01:23:20 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:20 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8" returned: 0 in 0.265s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-232888739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299f565a-1efa-4ad2-b7b8-3d9b6b8b0370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:19Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Creating volume 299f565a-1efa-4ad2-b7b8-3d9b6b8b0370 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:23:20 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:20 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370 1073741824 Sep 01 01:23:20 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9be0df-30ad-4ade-b292-4d873c4998fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd325d8-9215-4e38-8a47-71ce9ce33019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:20 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8 (ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8): created successfully Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd325d8-9215-4e38-8a47-71ce9ce33019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (d601449a-5e06-4c4c-9548-ddef8653d4b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:20 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-525139e2-28b3-4f0d-b13d-6f369abbb15d tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created volume successfully. Sep 01 01:23:21 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370 1073741824" returned: 0 in 0.477s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:21 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370 Sep 01 01:23:21 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:21 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370" returned: 0 in 0.276s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.473s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-758995659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3650e51-3c6e-4819-81c1-d3fb951dc985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:20Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Creating volume f3650e51-3c6e-4819-81c1-d3fb951dc985 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:23:21 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:21 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985 1073741824 Sep 01 01:23:21 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc183fc-65eb-4210-9c2f-96503893e816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd90bac1-2055-4c77-aa4b-e02b14863d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:21 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370 (299f565a-1efa-4ad2-b7b8-3d9b6b8b0370): created successfully Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd90bac1-2055-4c77-aa4b-e02b14863d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (751214e8-1f34-43ae-88a0-b9910f8b05e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6db323ef-a107-4250-aef7-04d0b502252f tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created volume successfully. Sep 01 01:23:21 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985 1073741824" returned: 0 in 0.457s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:21 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985 Sep 01 01:23:21 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:22 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985" returned: 0 in 0.276s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.889s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1321965901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d4080d-e78a-4291-b20e-c8749147ecf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab193b377cd448d9d952c10b70bb501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:20Z,use_quota=True,user_id='01655c1f6cc0454ab3968eb4b3c0f515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Creating volume 68d4080d-e78a-4291-b20e-c8749147ecf5 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:23:22 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b178ab-22ff-4e31-bc67-a68afe85bfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3650e51-3c6e-4819-81c1-d3fb951dc985', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1dac2c-10e8-454d-95ba-2f5a1a5c27bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:22 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5 1073741824 Sep 01 01:23:22 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:22 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume volume-f3650e51-3c6e-4819-81c1-d3fb951dc985 (f3650e51-3c6e-4819-81c1-d3fb951dc985): created successfully Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1dac2c-10e8-454d-95ba-2f5a1a5c27bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (f5db3d2a-1466-4129-8ebd-d572f4c100fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:22 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2ec8af7a-b8a2-4884-a333-cab2ee9660be tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created volume successfully. Sep 01 01:23:22 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5 1073741824" returned: 0 in 0.514s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:22 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5 Sep 01 01:23:22 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:22 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5" returned: 0 in 0.263s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b628e9-cbaa-454f-9d27-5be4ef1fbcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d4080d-e78a-4291-b20e-c8749147ecf5', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0f9272-1c76-4c35-83d5-ea6cafd1b291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:22 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Volume volume-68d4080d-e78a-4291-b20e-c8749147ecf5 (68d4080d-e78a-4291-b20e-c8749147ecf5): created successfully Sep 01 01:23:22 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0f9272-1c76-4c35-83d5-ea6cafd1b291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Flow 'volume_create_manager' (dea25224-18f7-4fea-9782-2f78b1ed1b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:23 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-062e8ac9-d1a1-4322-88c1-ad2f95eadb75 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created volume successfully. Sep 01 01:23:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-68d4080d-e78a-4291-b20e-c8749147ecf5-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-68d4080d-e78a-4291-b20e-c8749147ecf5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-quobyte-68d4080d-e78a-4291-b20e-c8749147ecf5" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-68d4080d-e78a-4291-b20e-c8749147ecf5" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:23 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[db58e76a-8f3d-4a17-9e51-e21d18c02238]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:23 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5 Sep 01 01:23:23 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:24 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5" returned: 0 in 0.394s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:24 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5 Sep 01 01:23:24 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:24 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-68d4080d-e78a-4291-b20e-c8749147ecf5" returned: 0 in 0.273s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-68d4080d-e78a-4291-b20e-c8749147ecf5" released by "delete_volume" :: held 0.713s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created reservations ['a9009b54-7470-4edf-bc4a-01c5763409d2', 'c98189d8-ec22-47e8-8fdd-76e50161791a', '21b2956b-85f8-40b3-8d3e-53adda6f0870', '30bd6067-78c5-4c25-9633-c2ee4cd76bae'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:24 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:23:24 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-f3650e51-3c6e-4819-81c1-d3fb951dc985-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:24 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.318s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:23:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-f3650e51-3c6e-4819-81c1-d3fb951dc985-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:24 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Deleted volume successfully. Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11fca1d4-9021-4ca7-af3b-f673a5167380 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-68d4080d-e78a-4291-b20e-c8749147ecf5-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-quobyte-f3650e51-3c6e-4819-81c1-d3fb951dc985" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-f3650e51-3c6e-4819-81c1-d3fb951dc985" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[906a0bd7-5f36-4d26-a4c9-70b4bf95d6cb]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:25 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985 Sep 01 01:23:25 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:25 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985" returned: 0 in 0.438s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:25 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985 Sep 01 01:23:25 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:25 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f3650e51-3c6e-4819-81c1-d3fb951dc985" returned: 0 in 0.265s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-f3650e51-3c6e-4819-81c1-d3fb951dc985" released by "delete_volume" :: held 0.748s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created reservations ['f93e2786-eb66-478f-ab33-cc6a097a58d5', '02a1b587-7841-4425-8ba6-57410ba8e3ba', '9d0ffa34-23fa-47a8-866e-8ca730361621', 'b64ae0e1-d2a7-43da-b264-d2ae56df8485'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:25 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:23:25 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:26 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.283s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:23:26 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Deleted volume successfully. Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-quobyte-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-eee47d96-5203-4f85-93c7-c86675f8f9e5 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-f3650e51-3c6e-4819-81c1-d3fb951dc985-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c347c8f9-d624-4937-8772-bf5018c51138]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:26 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370 Sep 01 01:23:26 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:26 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370" returned: 0 in 0.407s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:26 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370 Sep 01 01:23:26 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:26 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370" returned: 0 in 0.280s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370" released by "delete_volume" :: held 0.735s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created reservations ['20df6ac7-cdee-404c-b855-306e638f49f5', '7932aadc-aa73-4575-aac2-3dafab883b3a', '4ff58b67-83fb-4f3a-8900-1c9642f3afe6', 'f8767719-b9ac-4375-8c85-8bdb963ac46b'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:27 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:23:27 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:27 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.272s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:27 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Deleted volume successfully. Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-56c482fd-cbce-4366-a821-bfc195f237a8 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-299f565a-1efa-4ad2-b7b8-3d9b6b8b0370-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-quobyte-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bafcdf-87a2-4ce7-8af1-d61b6cb913dd]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:27 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8 Sep 01 01:23:27 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:27 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8" returned: 0 in 0.365s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:27 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8 Sep 01 01:23:27 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:28 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8" returned: 0 in 0.252s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8" released by "delete_volume" :: held 0.660s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created reservations ['e8236110-0db9-4db5-9ba3-130a49e3505a', '585f598e-7825-4c16-ba70-8216f9ce0980', '0969dde2-6980-4db4-b8ce-7de6734adf78', '0f1d468f-9b2b-422e-b8d6-55c031cf8873'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:28 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:23:28 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:28 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.253s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:23:28 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Deleted volume successfully. Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c1a17e80-d98d-4974-9d89-136f5b16a683 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-ef67d0ef-ed09-4c47-84f3-7e05fd59fcc8-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-03bfcf93-9281-479a-80a5-1c2efa714211-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-03bfcf93-9281-479a-80a5-1c2efa714211-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-quobyte-03bfcf93-9281-479a-80a5-1c2efa714211" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-03bfcf93-9281-479a-80a5-1c2efa714211" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed486d5c-507b-4bb0-afa5-6ea00042d85b]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:28 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211 Sep 01 01:23:28 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:29 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211" returned: 0 in 0.376s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:29 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211 Sep 01 01:23:29 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:29 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-03bfcf93-9281-479a-80a5-1c2efa714211" returned: 0 in 0.260s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-03bfcf93-9281-479a-80a5-1c2efa714211" released by "delete_volume" :: held 0.679s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created reservations ['d563edf6-6a29-4c40-8d6d-cc0e74d73cc1', 'cdefe8d1-3668-4ea9-bac7-2f5c4fc06b30', 'ff77ac8f-0dec-4b1d-9412-34301bb4de6a', '94df0392-2924-4b48-8fc2-d7a1d6bd9a08'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:29 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:23:29 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:29 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.302s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:23:29 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Deleted volume successfully. Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-4df567bb-099d-4eaa-98b2-711644bc6c48-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-4df567bb-099d-4eaa-98b2-711644bc6c48-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0114fcea-d847-45c1-9698-86a37e6b3294 tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-03bfcf93-9281-479a-80a5-1c2efa714211-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "cinder-quobyte-4df567bb-099d-4eaa-98b2-711644bc6c48" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-4df567bb-099d-4eaa-98b2-711644bc6c48" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd7de26-e71d-4c76-a4ed-eb4c77ef258b]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:30 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48 Sep 01 01:23:30 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:30 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48" returned: 0 in 0.418s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:30 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48 Sep 01 01:23:30 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:30 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4df567bb-099d-4eaa-98b2-711644bc6c48" returned: 0 in 0.267s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:30 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-quobyte-4df567bb-099d-4eaa-98b2-711644bc6c48" released by "delete_volume" :: held 0.735s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:30 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Created reservations ['06718121-ce1b-4601-a616-b6bcc5e4faaf', '4dc4b9ed-4586-4118-bf87-9ec3ba4a6cdd', '213294d4-2ff3-4b18-8337-33730beefc39', 'cf492592-d094-402c-85e5-d2b62221e38b'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:23:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:30 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:23:30 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:31 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.277s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:31 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:23:31 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Deleted volume successfully. Sep 01 01:23:31 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a26b24ad-d8d7-440b-879c-58b19c3d65fd tempest-CreateVolumesFromSourceVolumeTest-116399717 None] Lock "cinder-4df567bb-099d-4eaa-98b2-711644bc6c48-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Flow 'volume_create_manager' (4ad17298-87e2-4d54-907b-4fc508825c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee24699a-5365-41b1-a578-4111c29c22e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee24699a-5365-41b1-a578-4111c29c22e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1536453373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9644bf7f-87a8-4356-a988-a38b06906eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faebc63d5eaf4f249e416a9ae8da9f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:34Z,use_quota=True,user_id='00704dd69d4d4a6cbdb0f9b416da2730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48142632-4f0f-45af-8f7c-8b66285a6e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48142632-4f0f-45af-8f7c-8b66285a6e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59142027-7d55-4a8c-87ba-3550baa1d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59142027-7d55-4a8c-87ba-3550baa1d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9644bf7f-87a8-4356-a988-a38b06906eee', 'volume_name': 'volume-9644bf7f-87a8-4356-a988-a38b06906eee', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbc8c21-bb5a-45c2-b457-4363849e3e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbc8c21-bb5a-45c2-b457-4363849e3e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50309f71-70d9-4a8d-86b8-ee16c8ca3070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:33 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Volume 9644bf7f-87a8-4356-a988-a38b06906eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9644bf7f-87a8-4356-a988-a38b06906eee', 'volume_size': 1} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1536453373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9644bf7f-87a8-4356-a988-a38b06906eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faebc63d5eaf4f249e416a9ae8da9f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:34Z,use_quota=True,user_id='00704dd69d4d4a6cbdb0f9b416da2730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Creating volume 9644bf7f-87a8-4356-a988-a38b06906eee {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:23:33 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:23:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:33 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee 1073741824 Sep 01 01:23:33 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:34 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee 1073741824" returned: 0 in 0.435s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:34 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee Sep 01 01:23:34 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:34 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee" returned: 0 in 0.236s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50309f71-70d9-4a8d-86b8-ee16c8ca3070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9644bf7f-87a8-4356-a988-a38b06906eee', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8543c2a2-2de3-4b8a-a4d3-9ab1781d4f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:34 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Volume volume-9644bf7f-87a8-4356-a988-a38b06906eee (9644bf7f-87a8-4356-a988-a38b06906eee): created successfully Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8543c2a2-2de3-4b8a-a4d3-9ab1781d4f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Flow 'volume_create_manager' (4ad17298-87e2-4d54-907b-4fc508825c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f310382e-548d-4331-a427-55f0b8bba37a tempest-VolumeDependencyTests-1841518484 None] Created volume successfully. Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] Creating offline snapshot 8533b69f-ef14-4ef7-ae09-3add8ebd0e97 of volume 9644bf7f-87a8-4356-a988-a38b06906eee {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:23:35 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c550c22c-492d-4222-8f9a-ec1ead94b755]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:35 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee Sep 01 01:23:35 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:35 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee" returned: 0 in 0.404s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:35 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 1G Sep 01 01:23:35 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:35 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 1G" returned: 0 in 0.491s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9644bf7f-87a8-4356-a988-a38b06906eee -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:35 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9644bf7f-87a8-4356-a988-a38b06906eee -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 Sep 01 01:23:35 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:36 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9644bf7f-87a8-4356-a988-a38b06906eee -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97" returned: 0 in 0.333s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:36 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 is being set with open permissions: ugo+rw Sep 01 01:23:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:36 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 Sep 01 01:23:36 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:36 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97" returned: 0 in 0.244s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:36 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.info Sep 01 01:23:36 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:36 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.info" returned: 0 in 0.254s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:36 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.info is being set with open permissions: ugo+rw Sep 01 01:23:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:36 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.info Sep 01 01:23:36 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:37 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.info" returned: 0 in 0.238s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:37 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d4ad6749-25e4-4f40-b8ee-65b4d42f5308 tempest-VolumeDependencyTests-1841518484 None] Create snapshot completed successfully Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Flow 'volume_create_manager' (b523d28f-97c5-4c45-add5-3f30beb24875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984e2271-0bb5-4da4-a0cb-08a24bdbd515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984e2271-0bb5-4da4-a0cb-08a24bdbd515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-865017888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063f78ea-f304-4e6b-ac2c-0d6ab6d791ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faebc63d5eaf4f249e416a9ae8da9f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8533b69f-ef14-4ef7-ae09-3add8ebd0e97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:39Z,use_quota=True,user_id='00704dd69d4d4a6cbdb0f9b416da2730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4223d112-2e6e-4c57-9527-8ae31391a59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4223d112-2e6e-4c57-9527-8ae31391a59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a5e7fe-e153-4ddd-b31c-6644b2252b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a5e7fe-e153-4ddd-b31c-6644b2252b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '063f78ea-f304-4e6b-ac2c-0d6ab6d791ae', 'volume_name': 'volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae', 'volume_size': 1, 'snapshot_id': '8533b69f-ef14-4ef7-ae09-3add8ebd0e97'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97d3456-b737-4db4-a61b-9060c97a93b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97d3456-b737-4db4-a61b-9060c97a93b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad59105-395d-4324-ab50-80606f69dafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:38 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Volume 063f78ea-f304-4e6b-ac2c-0d6ab6d791ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae', 'volume_size': 1, 'snapshot_id': '8533b69f-ef14-4ef7-ae09-3add8ebd0e97'} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "cinder-quobyte-8533b69f-ef14-4ef7-ae09-3add8ebd0e97-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" by "_create_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-8533b69f-ef14-4ef7-ae09-3add8ebd0e97-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Creating volume 063f78ea-f304-4e6b-ac2c-0d6ab6d791ae from snapshot 8533b69f-ef14-4ef7-ae09-3add8ebd0e97 {{(pid=87064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "cinder-quobyte-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] snapshot: 8533b69f-ef14-4ef7-ae09-3add8ebd0e97, volume: 063f78ea-f304-4e6b-ac2c-0d6ab6d791ae, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03847c6-c74e-47f1-88f8-1161161a2985]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:39 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 Sep 01 01:23:39 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:39 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97" returned: 0 in 0.353s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9644bf7f-87a8-4356-a988-a38b06906eee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:23:39 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f87cbc-6640-4136-bed4-7965302e892e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:39 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee Sep 01 01:23:39 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:39 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee" returned: 0 in 0.371s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:23:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:23:39 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:23:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:39 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae Sep 01 01:23:39 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:43 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" returned: 0 in 4.258s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:43 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:23:43 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Converted 1024.00 MB image at 240.39 MB/s Sep 01 01:23:43 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae is being set with open permissions: ugo+rw Sep 01 01:23:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:43 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae Sep 01 01:23:43 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:44 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" returned: 0 in 0.286s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" released by "_copy_volume_from_snapshot" :: held 5.359s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-8533b69f-ef14-4ef7-ae09-3add8ebd0e97-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" released by "_create_volume_from_snapshot" :: held 5.442s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.461s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad59105-395d-4324-ab50-80606f69dafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae', 'volume_size': 1, 'snapshot_id': '8533b69f-ef14-4ef7-ae09-3add8ebd0e97'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0860ae4-a2cd-4496-920a-7a8aa354e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:44 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Volume volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae (063f78ea-f304-4e6b-ac2c-0d6ab6d791ae): created successfully Sep 01 01:23:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0860ae4-a2cd-4496-920a-7a8aa354e81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Flow 'volume_create_manager' (b523d28f-97c5-4c45-add5-3f30beb24875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:44 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5bdb699b-35e4-4f28-81c6-42931b47104c tempest-VolumeDependencyTests-1841518484 None] Created volume successfully. Sep 01 01:23:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "cinder-8533b69f-ef14-4ef7-ae09-3add8ebd0e97-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-8533b69f-ef14-4ef7-ae09-3add8ebd0e97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "cinder-quobyte-9644bf7f-87a8-4356-a988-a38b06906eee" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-9644bf7f-87a8-4356-a988-a38b06906eee" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "cinder-quobyte-8533b69f-ef14-4ef7-ae09-3add8ebd0e97" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-8533b69f-ef14-4ef7-ae09-3add8ebd0e97" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Deleting offline snapshot 8533b69f-ef14-4ef7-ae09-3add8ebd0e97 of volume 9644bf7f-87a8-4356-a988-a38b06906eee {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:23:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] snapshot_file for this snap is: volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:23:45 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3443dbb1-bd08-482e-b1f8-39e4780b2bbc]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:45 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 Sep 01 01:23:45 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:46 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97" returned: 0 in 0.377s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9644bf7f-87a8-4356-a988-a38b06906eee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:23:46 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[69363904-9916-4e15-a65b-a663490f4e68]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:46 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee Sep 01 01:23:46 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:46 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee" returned: 0 in 0.565s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:46 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 Sep 01 01:23:46 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:46 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97" returned: 0 in 0.380s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:47 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97 Sep 01 01:23:47 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:47 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee.8533b69f-ef14-4ef7-ae09-3add8ebd0e97" returned: 0 in 0.283s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-8533b69f-ef14-4ef7-ae09-3add8ebd0e97" released by "_delete_snapshot" :: held 1.709s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-9644bf7f-87a8-4356-a988-a38b06906eee" released by "delete_snapshot" :: held 1.733s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:47 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Created reservations ['4c1ed4dd-6630-4f2f-8041-ae85aa02c42b', '87049528-bc11-4255-a19e-13ece662cd5e', '549aa252-889d-4c00-92ca-6f42712cc0c0', '90391836-f40d-49a0-bc73-e96148277ed2'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:23:47 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Delete snapshot completed successfully. Sep 01 01:23:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f292045e-2bb3-4261-83f0-476ee069e7f1 tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-8533b69f-ef14-4ef7-ae09-3add8ebd0e97-delete_snapshot" released by "delete_snapshot" :: held 1.896s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "cinder-9644bf7f-87a8-4356-a988-a38b06906eee-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-9644bf7f-87a8-4356-a988-a38b06906eee-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "cinder-quobyte-9644bf7f-87a8-4356-a988-a38b06906eee" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-9644bf7f-87a8-4356-a988-a38b06906eee" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:47 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ab0ad7-edf3-45ba-a2d0-f5ed7be3fbc5]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:47 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee Sep 01 01:23:47 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:48 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee" returned: 0 in 0.439s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:48 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee Sep 01 01:23:48 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:48 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9644bf7f-87a8-4356-a988-a38b06906eee" returned: 0 in 0.318s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-9644bf7f-87a8-4356-a988-a38b06906eee" released by "delete_volume" :: held 0.825s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Created reservations ['96aa8736-ae45-443d-8353-f41eab1d537d', '8d7604f0-e96c-4f59-bee7-122dad1d753a', '395059b2-e874-47c2-9a6e-1ba08b2f3bde', '21e840fe-6fbb-4f46-9490-bd70707ea9b6'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:48 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:23:48 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "cinder-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "cinder-quobyte-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" acquired by "delete_volume" :: waited 0.029s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8b1900-c3f5-41e4-8be7-1693fdc7aea9]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:49 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.380s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:23:49 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae Sep 01 01:23:49 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:49 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Deleted volume successfully. Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e380d614-cf3f-44de-9006-6fa9ee3d1753 tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-9644bf7f-87a8-4356-a988-a38b06906eee-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:49 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" returned: 0 in 0.383s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:49 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae Sep 01 01:23:49 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:49 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" returned: 0 in 0.253s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-quobyte-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae" released by "delete_volume" :: held 0.681s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Created reservations ['5f23ddeb-ebaa-4516-961d-7aadc454bc0f', '57069bc6-0681-4d01-a7eb-fd8c251c50fa', '1afc5c16-f07c-4187-a280-839143d944b1', '7473e401-1973-493a-9004-e516048d3033'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:49 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:23:49 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:50 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.240s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:50 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:23:50 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Deleted volume successfully. Sep 01 01:23:50 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-a39ade7c-99ac-4d1d-8321-b7284c11956e tempest-VolumeDependencyTests-1841518484 None] Lock "cinder-063f78ea-f304-4e6b-ac2c-0d6ab6d791ae-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:23:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:23:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:52 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:23:52 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:52 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.287s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Flow 'volume_create_manager' (1878be0f-1a3d-4ae2-aaee-7cf19df90004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f5f9bd-18df-46df-846e-d09bcdb524cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f5f9bd-18df-46df-846e-d09bcdb524cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb41692-66fb-45f8-9006-bcee79138cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e28105f0bf44c968675a80f7805d554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:53Z,use_quota=True,user_id='d102fbb9e81d46ebb6cf31c9a9c1a4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f5fba6-094e-4935-9e9b-e13520dd0f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f5fba6-094e-4935-9e9b-e13520dd0f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a129487-300a-4951-bdaf-c1a70c32bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a129487-300a-4951-bdaf-c1a70c32bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb41692-66fb-45f8-9006-bcee79138cd9', 'volume_name': 'volume-3fb41692-66fb-45f8-9006-bcee79138cd9', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14cc750-995f-4454-88a0-aa1b401b1497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14cc750-995f-4454-88a0-aa1b401b1497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f476558d-2088-4802-8467-b1d0f752f95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:53 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Volume 3fb41692-66fb-45f8-9006-bcee79138cd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb41692-66fb-45f8-9006-bcee79138cd9', 'volume_size': 1} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb41692-66fb-45f8-9006-bcee79138cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e28105f0bf44c968675a80f7805d554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:53Z,use_quota=True,user_id='d102fbb9e81d46ebb6cf31c9a9c1a4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Creating volume 3fb41692-66fb-45f8-9006-bcee79138cd9 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:23:53 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:53 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9 1073741824 Sep 01 01:23:53 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:53 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9 1073741824" returned: 0 in 0.481s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:53 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9 Sep 01 01:23:53 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:54 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9" returned: 0 in 0.283s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:23:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f476558d-2088-4802-8467-b1d0f752f95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb41692-66fb-45f8-9006-bcee79138cd9', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0037a236-1702-493a-8260-55dd8fa3aa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:54 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Volume volume-3fb41692-66fb-45f8-9006-bcee79138cd9 (3fb41692-66fb-45f8-9006-bcee79138cd9): created successfully Sep 01 01:23:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0037a236-1702-493a-8260-55dd8fa3aa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Flow 'volume_create_manager' (1878be0f-1a3d-4ae2-aaee-7cf19df90004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f254a811-545f-4e8e-ac08-f1a3e448a14f tempest-CinderUnicodeTest-622319033 None] Created volume successfully. Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Flow 'volume_create_manager' (4eccfe73-5eeb-4943-8ce3-56c9c828ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba8e8f7-67cc-4279-a488-2324c8651f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba8e8f7-67cc-4279-a488-2324c8651f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-847212880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a46e7c1-6a51-427a-86b0-560baf66e513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e28105f0bf44c968675a80f7805d554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:56Z,use_quota=True,user_id='d102fbb9e81d46ebb6cf31c9a9c1a4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff11912-6a5c-465d-b6c6-9ba9eef68e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff11912-6a5c-465d-b6c6-9ba9eef68e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f39fa06-059e-4883-a0d3-2d38f686f409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f39fa06-059e-4883-a0d3-2d38f686f409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a46e7c1-6a51-427a-86b0-560baf66e513', 'volume_name': 'volume-3a46e7c1-6a51-427a-86b0-560baf66e513', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042110d6-b2ef-4454-87e1-0eae771cdec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042110d6-b2ef-4454-87e1-0eae771cdec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab63ce0-5307-4120-8112-f22f0b15b878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:56 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Volume 3a46e7c1-6a51-427a-86b0-560baf66e513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a46e7c1-6a51-427a-86b0-560baf66e513', 'volume_size': 1} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:23:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-847212880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a46e7c1-6a51-427a-86b0-560baf66e513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e28105f0bf44c968675a80f7805d554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:23:56Z,use_quota=True,user_id='d102fbb9e81d46ebb6cf31c9a9c1a4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Creating volume 3a46e7c1-6a51-427a-86b0-560baf66e513 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:23:56 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:56 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 1073741824 Sep 01 01:23:56 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:56 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 1073741824" returned: 0 in 0.536s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:56 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 Sep 01 01:23:56 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:57 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513" returned: 0 in 0.256s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:23:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:23:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab63ce0-5307-4120-8112-f22f0b15b878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a46e7c1-6a51-427a-86b0-560baf66e513', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0854eba-6ebb-4770-a23d-aaef3e6fcd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:23:57 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Volume volume-3a46e7c1-6a51-427a-86b0-560baf66e513 (3a46e7c1-6a51-427a-86b0-560baf66e513): created successfully Sep 01 01:23:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0854eba-6ebb-4770-a23d-aaef3e6fcd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:23:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Flow 'volume_create_manager' (4eccfe73-5eeb-4943-8ce3-56c9c828ffee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:23:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-df779298-b7c0-4ae4-a22b-7c2b060d99c6 tempest-CinderUnicodeTest-622319033 None] Created volume successfully. Sep 01 01:23:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:23:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:23:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] Creating offline snapshot c40e9ad7-864c-4b80-bc7f-e188f5d38642 of volume 3a46e7c1-6a51-427a-86b0-560baf66e513 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:23:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ce611a-7f28-41c5-8054-843b34596b08]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:23:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:58 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 Sep 01 01:23:58 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:59 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513" returned: 0 in 0.454s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:59 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 1G Sep 01 01:23:59 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:59 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 1G" returned: 0 in 0.456s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a46e7c1-6a51-427a-86b0-560baf66e513 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:59 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a46e7c1-6a51-427a-86b0-560baf66e513 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 Sep 01 01:23:59 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:23:59 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 01 01:23:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a46e7c1-6a51-427a-86b0-560baf66e513 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642" returned: 0 in 0.301s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:23:59 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 is being set with open permissions: ugo+rw Sep 01 01:23:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:23:59 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 Sep 01 01:23:59 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:00 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642" returned: 0 in 0.294s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:00 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.info Sep 01 01:24:00 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:00 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.info" returned: 0 in 0.294s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:00 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.info is being set with open permissions: ugo+rw Sep 01 01:24:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:00 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.info Sep 01 01:24:00 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:00 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.info" returned: 0 in 0.326s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-069c15b1-415e-4a7b-b11e-d995363c1d7e tempest-CinderUnicodeTest-622319033 None] Create snapshot completed successfully Sep 01 01:24:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Acquiring lock "cinder-c40e9ad7-864c-4b80-bc7f-e188f5d38642-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Lock "cinder-c40e9ad7-864c-4b80-bc7f-e188f5d38642-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Acquiring lock "cinder-quobyte-3a46e7c1-6a51-427a-86b0-560baf66e513" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Lock "cinder-quobyte-3a46e7c1-6a51-427a-86b0-560baf66e513" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Acquiring lock "cinder-quobyte-c40e9ad7-864c-4b80-bc7f-e188f5d38642" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Lock "cinder-quobyte-c40e9ad7-864c-4b80-bc7f-e188f5d38642" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Deleting offline snapshot c40e9ad7-864c-4b80-bc7f-e188f5d38642 of volume 3a46e7c1-6a51-427a-86b0-560baf66e513 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:24:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] snapshot_file for this snap is: volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:24:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e362ec6-d8ff-4896-90ae-6fb22f29c2e6]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:02 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 Sep 01 01:24:02 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:02 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642" returned: 0 in 0.469s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a46e7c1-6a51-427a-86b0-560baf66e513(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:24:02 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d490a043-acfa-448e-9a79-15384c62ef66]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:02 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 Sep 01 01:24:02 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:02 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513" returned: 0 in 0.411s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:02 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 Sep 01 01:24:02 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:03 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642" returned: 0 in 0.408s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:03 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642 Sep 01 01:24:03 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:03 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513.c40e9ad7-864c-4b80-bc7f-e188f5d38642" returned: 0 in 0.262s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Lock "cinder-quobyte-c40e9ad7-864c-4b80-bc7f-e188f5d38642" released by "_delete_snapshot" :: held 1.686s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Lock "cinder-quobyte-3a46e7c1-6a51-427a-86b0-560baf66e513" released by "delete_snapshot" :: held 1.716s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:03 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Created reservations ['0f5ef071-bc66-44b9-b2bd-49245d5ebb93', '15c11117-8424-4577-8242-4a369073c105', '13e8804c-6feb-468c-91fe-4fbd06f09489', 'fba718b6-7acb-4ac7-8f02-505ac09a2b8f'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:03 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Delete snapshot completed successfully. Sep 01 01:24:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-bdf1d593-a789-4ca1-837f-8cabb282b23d tempest-CinderUnicodeTest-622319033 None] Lock "cinder-c40e9ad7-864c-4b80-bc7f-e188f5d38642-delete_snapshot" released by "delete_snapshot" :: held 1.891s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Acquiring lock "cinder-3a46e7c1-6a51-427a-86b0-560baf66e513-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Lock "cinder-3a46e7c1-6a51-427a-86b0-560baf66e513-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Acquiring lock "cinder-quobyte-3a46e7c1-6a51-427a-86b0-560baf66e513" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Lock "cinder-quobyte-3a46e7c1-6a51-427a-86b0-560baf66e513" acquired by "delete_volume" :: waited 0.014s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51a0454-f47f-4fd5-b11f-d67808000fa7]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:04 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 Sep 01 01:24:04 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:04 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513" returned: 0 in 0.357s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:04 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513 Sep 01 01:24:04 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:04 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3a46e7c1-6a51-427a-86b0-560baf66e513" returned: 0 in 0.254s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Lock "cinder-quobyte-3a46e7c1-6a51-427a-86b0-560baf66e513" released by "delete_volume" :: held 0.668s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Created reservations ['25e9f955-30cc-40a5-93f9-5d8f706886cd', '6953526f-9080-43e4-b58d-b3c0fc7e9686', '156cda88-675a-4383-b42e-5cd55269fbff', '0177da15-0236-448f-ab2c-363eeb708060'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:04 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:04 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:05 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.264s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Acquiring lock "cinder-3fb41692-66fb-45f8-9006-bcee79138cd9-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:05 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Deleted volume successfully. Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Lock "cinder-3fb41692-66fb-45f8-9006-bcee79138cd9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c0ce5c50-cda9-4ede-a276-e2a883499afc tempest-CinderUnicodeTest-622319033 None] Lock "cinder-3a46e7c1-6a51-427a-86b0-560baf66e513-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Acquiring lock "cinder-quobyte-3fb41692-66fb-45f8-9006-bcee79138cd9" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Lock "cinder-quobyte-3fb41692-66fb-45f8-9006-bcee79138cd9" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f950e6-9879-4fce-a8c4-c6eabe4e5eb5]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:05 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9 Sep 01 01:24:05 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:05 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9" returned: 0 in 0.364s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:05 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9 Sep 01 01:24:05 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:05 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3fb41692-66fb-45f8-9006-bcee79138cd9" returned: 0 in 0.240s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Lock "cinder-quobyte-3fb41692-66fb-45f8-9006-bcee79138cd9" released by "delete_volume" :: held 0.644s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:06 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Created reservations ['29cdb13f-739c-4b0b-9906-03d629ff1fe9', 'b2b21dbc-29f5-4f12-a218-b664cfa68f09', 'd654ffb1-0983-403c-be97-1078c5a56bd4', 'ae9e113e-fc72-4703-bb78-15d3b4db3b44'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:06 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:06 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:06 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.251s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:06 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Deleted volume successfully. Sep 01 01:24:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70518c52-bcbc-4754-97a0-b28153c26f01 tempest-CinderUnicodeTest-622319033 None] Lock "cinder-3fb41692-66fb-45f8-9006-bcee79138cd9-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=124,cinder:SELECT=89,cinder:INSERT=26,cinder:DELETE=12 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=92,cinder:UPDATE=126,cinder:INSERT=34,cinder:DELETE=10 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Flow 'volume_create_manager' (b0edb77f-c1cb-4da6-9849-ec9d73ecf9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc3c1b6-8520-4d1a-8b9d-780d612484ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc3c1b6-8520-4d1a-8b9d-780d612484ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925290298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e771d8ac-2879-41d3-9bad-26336ca62782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486b3d9940fc4a8893a7302c4ff25b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:15Z,use_quota=True,user_id='24f8353ba36449e3bbbc6f71f433eeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef16846d-c4c3-4ae3-9a81-1bc753b0f389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef16846d-c4c3-4ae3-9a81-1bc753b0f389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa39d8d-42ee-4e47-8761-1b0d37e5d886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa39d8d-42ee-4e47-8761-1b0d37e5d886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e771d8ac-2879-41d3-9bad-26336ca62782', 'volume_name': 'volume-e771d8ac-2879-41d3-9bad-26336ca62782', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce64a19-44a4-4b80-98d5-f10fcd2c8e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce64a19-44a4-4b80-98d5-f10fcd2c8e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fccc93-88b9-4372-8ee4-ff24b0a1313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:14 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Volume e771d8ac-2879-41d3-9bad-26336ca62782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e771d8ac-2879-41d3-9bad-26336ca62782', 'volume_size': 1} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925290298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e771d8ac-2879-41d3-9bad-26336ca62782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486b3d9940fc4a8893a7302c4ff25b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:15Z,use_quota=True,user_id='24f8353ba36449e3bbbc6f71f433eeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Creating volume e771d8ac-2879-41d3-9bad-26336ca62782 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:14 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:14 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782 1073741824 Sep 01 01:24:14 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:15 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782 1073741824" returned: 0 in 0.392s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:15 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782 Sep 01 01:24:15 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:15 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782" returned: 0 in 0.248s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fccc93-88b9-4372-8ee4-ff24b0a1313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e771d8ac-2879-41d3-9bad-26336ca62782', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdce8aa0-bf01-4097-8fe0-1616b0dc20c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:15 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Volume volume-e771d8ac-2879-41d3-9bad-26336ca62782 (e771d8ac-2879-41d3-9bad-26336ca62782): created successfully Sep 01 01:24:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdce8aa0-bf01-4097-8fe0-1616b0dc20c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Flow 'volume_create_manager' (b0edb77f-c1cb-4da6-9849-ec9d73ecf9cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e86d47a1-19e1-420b-96c0-14fc8b9d0f39 tempest-ProjectReaderTests-1657814578 None] Created volume successfully. Sep 01 01:24:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Acquiring lock "cinder-e771d8ac-2879-41d3-9bad-26336ca62782-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Lock "cinder-e771d8ac-2879-41d3-9bad-26336ca62782-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Acquiring lock "cinder-quobyte-e771d8ac-2879-41d3-9bad-26336ca62782" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Lock "cinder-quobyte-e771d8ac-2879-41d3-9bad-26336ca62782" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5c11f6-e55d-48d0-a144-08f026b35200]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:16 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782 Sep 01 01:24:16 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:16 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782" returned: 0 in 0.392s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:16 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782 Sep 01 01:24:16 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:16 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e771d8ac-2879-41d3-9bad-26336ca62782" returned: 0 in 0.294s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Lock "cinder-quobyte-e771d8ac-2879-41d3-9bad-26336ca62782" released by "delete_volume" :: held 0.733s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Created reservations ['947e0791-270e-4a08-a3af-5ef3176c49db', 'f40cdcf6-d28b-407b-a89c-d366d278f47e', '64fe65aa-86ef-47c4-b1bc-9d5e43782b0d', '5ed89bc2-5a8c-4ed8-ad7f-7849f3a41cf3'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:16 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:16 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:17 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.279s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:17 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Deleted volume successfully. Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-46e0cd6d-7c08-4823-8afc-3ea1bb341b1b tempest-ProjectReaderTests-1657814578 None] Lock "cinder-e771d8ac-2879-41d3-9bad-26336ca62782-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Flow 'volume_create_manager' (546ed689-bc75-440d-b0c6-a2bf0198b9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c532de-ab7f-4efd-b314-5e8f27dec7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c532de-ab7f-4efd-b314-5e8f27dec7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095875541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d77750-8208-421d-885e-db9ce22cbe08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486b3d9940fc4a8893a7302c4ff25b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:18Z,use_quota=True,user_id='24f8353ba36449e3bbbc6f71f433eeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce5e785-d5f4-4704-9d70-c9e0da328d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce5e785-d5f4-4704-9d70-c9e0da328d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6997c35-f7e2-436b-be49-1c919d58b36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6997c35-f7e2-436b-be49-1c919d58b36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d77750-8208-421d-885e-db9ce22cbe08', 'volume_name': 'volume-59d77750-8208-421d-885e-db9ce22cbe08', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4037252-73cc-4d32-b612-f1bfd95ac3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4037252-73cc-4d32-b612-f1bfd95ac3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e50dfdd-20e3-4cea-945e-462ecd3d9eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:17 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Volume 59d77750-8208-421d-885e-db9ce22cbe08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d77750-8208-421d-885e-db9ce22cbe08', 'volume_size': 1} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095875541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d77750-8208-421d-885e-db9ce22cbe08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486b3d9940fc4a8893a7302c4ff25b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:18Z,use_quota=True,user_id='24f8353ba36449e3bbbc6f71f433eeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Creating volume 59d77750-8208-421d-885e-db9ce22cbe08 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:17 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:17 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08 1073741824 Sep 01 01:24:17 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:18 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08 1073741824" returned: 0 in 0.403s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:18 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08 Sep 01 01:24:18 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:18 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08" returned: 0 in 0.235s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e50dfdd-20e3-4cea-945e-462ecd3d9eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d77750-8208-421d-885e-db9ce22cbe08', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccaaa565-ea40-4df1-a768-709661aec792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:18 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Volume volume-59d77750-8208-421d-885e-db9ce22cbe08 (59d77750-8208-421d-885e-db9ce22cbe08): created successfully Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccaaa565-ea40-4df1-a768-709661aec792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Flow 'volume_create_manager' (546ed689-bc75-440d-b0c6-a2bf0198b9dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-19342d07-bec4-478d-bc1c-607d7599140d tempest-ProjectReaderTests-1657814578 None] Created volume successfully. Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Acquiring lock "cinder-59d77750-8208-421d-885e-db9ce22cbe08-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Lock "cinder-59d77750-8208-421d-885e-db9ce22cbe08-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Acquiring lock "cinder-quobyte-59d77750-8208-421d-885e-db9ce22cbe08" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Lock "cinder-quobyte-59d77750-8208-421d-885e-db9ce22cbe08" acquired by "delete_volume" :: waited 0.014s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7d3b85-4241-4380-8c5f-0015ad1b7b15]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:18 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08 Sep 01 01:24:18 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:19 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08" returned: 0 in 0.384s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:19 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08 Sep 01 01:24:19 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:19 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-59d77750-8208-421d-885e-db9ce22cbe08" returned: 0 in 0.253s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Lock "cinder-quobyte-59d77750-8208-421d-885e-db9ce22cbe08" released by "delete_volume" :: held 0.676s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Created reservations ['a173df54-fc47-4e5a-b22f-2d3fffd34381', '9ed91206-1bbd-4105-86c3-c7c057e36abd', '8e16553c-ca21-4c0b-97d9-7ad145cbd640', 'b25d8ec9-a498-4072-8bd0-5ef9f7a0ea91'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:19 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:19 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:19 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.260s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:19 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Deleted volume successfully. Sep 01 01:24:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-fd634d7e-733b-49b4-b768-6f3d0bfe1d2c tempest-ProjectReaderTests-1657814578 None] Lock "cinder-59d77750-8208-421d-885e-db9ce22cbe08-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Flow 'volume_create_manager' (be224266-abe8-4a24-b6fe-61c771693da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6245811-c3f7-411e-a579-acdde2e3be78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6245811-c3f7-411e-a579-acdde2e3be78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-539792844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4666ce-b2e3-4bdd-88ed-5233dac87f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486b3d9940fc4a8893a7302c4ff25b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:20Z,use_quota=True,user_id='24f8353ba36449e3bbbc6f71f433eeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd9a364-943b-4c73-af83-7b583506c75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd9a364-943b-4c73-af83-7b583506c75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ac49eb-9724-4a87-938a-76524223f5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ac49eb-9724-4a87-938a-76524223f5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4666ce-b2e3-4bdd-88ed-5233dac87f4a', 'volume_name': 'volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90380edb-c460-4b4f-82f2-97ddbf9b3f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90380edb-c460-4b4f-82f2-97ddbf9b3f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5fcfff-5dcd-427b-b89a-3281a15f5024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:20 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Volume cc4666ce-b2e3-4bdd-88ed-5233dac87f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a', 'volume_size': 1} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-539792844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4666ce-b2e3-4bdd-88ed-5233dac87f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486b3d9940fc4a8893a7302c4ff25b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:20Z,use_quota=True,user_id='24f8353ba36449e3bbbc6f71f433eeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Creating volume cc4666ce-b2e3-4bdd-88ed-5233dac87f4a {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:20 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:20 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a 1073741824 Sep 01 01:24:20 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:20 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a 1073741824" returned: 0 in 0.407s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:20 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a Sep 01 01:24:20 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:21 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a" returned: 0 in 0.250s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5fcfff-5dcd-427b-b89a-3281a15f5024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b59cc11-6881-44b1-ace3-fc183a911d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:21 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Volume volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a (cc4666ce-b2e3-4bdd-88ed-5233dac87f4a): created successfully Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b59cc11-6881-44b1-ace3-fc183a911d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Flow 'volume_create_manager' (be224266-abe8-4a24-b6fe-61c771693da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0cc436c4-e1eb-4096-a43c-09034d2f4220 tempest-ProjectReaderTests-1657814578 None] Created volume successfully. Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "cinder-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Lock "cinder-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "cinder-quobyte-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Lock "cinder-quobyte-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a" acquired by "delete_volume" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c520b0-00d7-48b6-97f2-9d1712691f66]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:21 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a Sep 01 01:24:21 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:21 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a" returned: 0 in 0.367s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:21 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a Sep 01 01:24:21 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:22 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a" returned: 0 in 0.236s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Lock "cinder-quobyte-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a" released by "delete_volume" :: held 0.643s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Created reservations ['7ac3392d-d353-484f-be96-f75e45fc4a48', '2e5b13b0-a2cf-4230-a13f-795ddff599a2', '2531a7af-738e-4cc6-813a-fbec89b81737', 'e5c89841-9d45-4af4-92fe-0e837258e10e'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:22 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:22 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:22 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.263s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:22 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Deleted volume successfully. Sep 01 01:24:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7fc91d00-4cd0-470d-940c-3afedc536085 tempest-ProjectReaderTests-1657814578 None] Lock "cinder-cc4666ce-b2e3-4bdd-88ed-5233dac87f4a-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Flow 'volume_create_manager' (ba87571f-5bb4-4fed-b72b-ffd47ca510da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405e12f8-e801-42ec-8605-5ba3c046a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405e12f8-e801-42ec-8605-5ba3c046a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144616146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530c6a78-1e83-4dc1-9824-0ea9e46d6fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486b3d9940fc4a8893a7302c4ff25b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:23Z,use_quota=True,user_id='24f8353ba36449e3bbbc6f71f433eeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933afedf-bd75-419d-a56f-a2294b8051f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933afedf-bd75-419d-a56f-a2294b8051f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560cf517-b5e0-474d-9c7b-4e0f17819229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560cf517-b5e0-474d-9c7b-4e0f17819229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530c6a78-1e83-4dc1-9824-0ea9e46d6fde', 'volume_name': 'volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839df5f0-d207-48c4-8971-eed39dfd1faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839df5f0-d207-48c4-8971-eed39dfd1faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b4bbe3-1239-4b48-a47c-9425fb695f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:23 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Volume 530c6a78-1e83-4dc1-9824-0ea9e46d6fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde', 'volume_size': 1} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144616146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530c6a78-1e83-4dc1-9824-0ea9e46d6fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486b3d9940fc4a8893a7302c4ff25b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:23Z,use_quota=True,user_id='24f8353ba36449e3bbbc6f71f433eeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Creating volume 530c6a78-1e83-4dc1-9824-0ea9e46d6fde {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:23 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:23 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde 1073741824 Sep 01 01:24:23 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:23 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde 1073741824" returned: 0 in 0.445s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:23 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde Sep 01 01:24:23 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:23 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde" returned: 0 in 0.249s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b4bbe3-1239-4b48-a47c-9425fb695f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cc6718-cb0c-4c6a-bfcc-4824484142e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:24 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Volume volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde (530c6a78-1e83-4dc1-9824-0ea9e46d6fde): created successfully Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cc6718-cb0c-4c6a-bfcc-4824484142e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Flow 'volume_create_manager' (ba87571f-5bb4-4fed-b72b-ffd47ca510da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:24 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6a1ec8ff-602e-4d92-8f30-f0262c85a885 tempest-ProjectReaderTests-1657814578 None] Created volume successfully. Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "cinder-530c6a78-1e83-4dc1-9824-0ea9e46d6fde-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Lock "cinder-530c6a78-1e83-4dc1-9824-0ea9e46d6fde-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "cinder-quobyte-530c6a78-1e83-4dc1-9824-0ea9e46d6fde" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Lock "cinder-quobyte-530c6a78-1e83-4dc1-9824-0ea9e46d6fde" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c5888c-e5d5-470e-9629-a364e3ced680]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:24 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde Sep 01 01:24:24 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:24 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde" returned: 0 in 0.414s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:24 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde Sep 01 01:24:24 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:24 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-530c6a78-1e83-4dc1-9824-0ea9e46d6fde" returned: 0 in 0.269s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Lock "cinder-quobyte-530c6a78-1e83-4dc1-9824-0ea9e46d6fde" released by "delete_volume" :: held 0.723s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:25 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Created reservations ['48ef9a63-ebf6-413a-811a-0196ccd4c7c5', 'd7e08c44-0306-4542-970a-cf4b52baca86', 'b5101408-3d57-4f78-ab3d-ab1a9982e5a2', '03637cbf-1ddc-45f4-a7e4-6afb78c8f106'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:25 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:25 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:25 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.296s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:25 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:25 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Deleted volume successfully. Sep 01 01:24:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-78c8f6fb-9365-4646-8a55-627d9b95d1f2 tempest-ProjectReaderTests-1657814578 None] Lock "cinder-530c6a78-1e83-4dc1-9824-0ea9e46d6fde-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:35 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=26,cinder:UPDATE=42,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:24:35 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=29,cinder:UPDATE=45,cinder:DELETE=7,cinder:INSERT=8 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Flow 'volume_create_manager' (d0434d40-2b96-4d17-acce-bb2a8d174558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dbdf39-cc5f-4802-aaa7-bb6df80eb0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dbdf39-cc5f-4802-aaa7-bb6df80eb0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527830244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ba13e5-9a86-4e3c-9972-a8694417ceb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3246487108c84666879bde7894feee49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:38Z,use_quota=True,user_id='be1951a5e8ef447a8e3e94c7a5289d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d280e0-cbce-4544-abf3-7c634808ac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d280e0-cbce-4544-abf3-7c634808ac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adad884-0614-4136-9ac1-4ceef3a5e612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adad884-0614-4136-9ac1-4ceef3a5e612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ba13e5-9a86-4e3c-9972-a8694417ceb5', 'volume_name': 'volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d38a20-2ced-4af7-bd22-2b86afbc67b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d38a20-2ced-4af7-bd22-2b86afbc67b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec66f4a-d047-44fa-a4d6-c543815c9d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:38 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Volume d2ba13e5-9a86-4e3c-9972-a8694417ceb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5', 'volume_size': 1} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527830244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ba13e5-9a86-4e3c-9972-a8694417ceb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3246487108c84666879bde7894feee49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:38Z,use_quota=True,user_id='be1951a5e8ef447a8e3e94c7a5289d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Creating volume d2ba13e5-9a86-4e3c-9972-a8694417ceb5 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:38 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:38 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5 1073741824 Sep 01 01:24:38 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (e060fa06-0cd2-4b0d-8243-115f02f66b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243a7e68-0aa2-4d65-851f-4b5ea4fb017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243a7e68-0aa2-4d65-851f-4b5ea4fb017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2007323251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f3813b-0d58-4065-bb6b-ab8ce8cbfba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:39Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00620e4-8550-49e7-a4bb-29faad9f8dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00620e4-8550-49e7-a4bb-29faad9f8dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182a4365-3b35-485c-834a-b659d25d2093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182a4365-3b35-485c-834a-b659d25d2093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f3813b-0d58-4065-bb6b-ab8ce8cbfba7', 'volume_name': 'volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b0d4d6-d823-4d7f-9d34-3545bf1347b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b0d4d6-d823-4d7f-9d34-3545bf1347b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5bd953b-d803-4e0e-a5d3-8234430a1418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:38 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume 39f3813b-0d58-4065-bb6b-ab8ce8cbfba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7', 'volume_size': 1} Sep 01 01:24:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Flow 'volume_create_manager' (7ef05cf5-2976-44b4-8119-63f1bf4961b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd34f9c4-1225-465b-9986-35067690050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd34f9c4-1225-465b-9986-35067690050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1312331147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a355eb6-83e0-48a1-93eb-f90ba9dccde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3246487108c84666879bde7894feee49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:39Z,use_quota=True,user_id='be1951a5e8ef447a8e3e94c7a5289d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f747ebd-c6d8-4958-b3f0-cdf0cf9bfc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f747ebd-c6d8-4958-b3f0-cdf0cf9bfc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c120d7-0dad-403e-8535-1801a4508528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c120d7-0dad-403e-8535-1801a4508528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a355eb6-83e0-48a1-93eb-f90ba9dccde1', 'volume_name': 'volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a707ae6e-1241-468a-9000-8628e8960023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a707ae6e-1241-468a-9000-8628e8960023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c0fb95-78f3-42bc-a24a-bc8ef66272a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Volume 2a355eb6-83e0-48a1-93eb-f90ba9dccde1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1', 'volume_size': 1} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (165ca764-d2ed-470d-8f17-cefacf18b411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e01932d-edda-4737-bf65-5eb5bc12e13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e01932d-edda-4737-bf65-5eb5bc12e13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1128506057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4e22a1-88a7-4918-8f58-0a6614282577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:39Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae3f5fa-238b-4fdc-a0e0-72ff3c968ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae3f5fa-238b-4fdc-a0e0-72ff3c968ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936b713d-5deb-4c0d-8071-26589fd7d820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936b713d-5deb-4c0d-8071-26589fd7d820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4e22a1-88a7-4918-8f58-0a6614282577', 'volume_name': 'volume-3b4e22a1-88a7-4918-8f58-0a6614282577', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89dd5e7b-48d5-4b37-9906-ebac32f8dda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89dd5e7b-48d5-4b37-9906-ebac32f8dda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e7306b-d30b-47f8-9f32-6a3f57c70fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume 3b4e22a1-88a7-4918-8f58-0a6614282577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4e22a1-88a7-4918-8f58-0a6614282577', 'volume_size': 1} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:39 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5 1073741824" returned: 0 in 0.810s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:39 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5 Sep 01 01:24:39 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Flow 'volume_create_manager' (c8dd34b8-8c55-4193-a1c8-0dd88b8cf524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfe7d3e-5768-40d8-995c-040de6a35d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfe7d3e-5768-40d8-995c-040de6a35d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266116079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bbbfa4-0fc7-478d-94b8-e799391fccfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3246487108c84666879bde7894feee49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:40Z,use_quota=True,user_id='be1951a5e8ef447a8e3e94c7a5289d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd037a9-4b53-43c2-9179-6f074bec630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd037a9-4b53-43c2-9179-6f074bec630b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e858fe-7584-4636-88cf-d0bebeb8ce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e858fe-7584-4636-88cf-d0bebeb8ce67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6bbbfa4-0fc7-478d-94b8-e799391fccfb', 'volume_name': 'volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e57659-e766-43f1-83ff-a56f299a0a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e57659-e766-43f1-83ff-a56f299a0a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389629df-1c27-420b-ab5e-d139d312d8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Volume c6bbbfa4-0fc7-478d-94b8-e799391fccfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb', 'volume_size': 1} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:39 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5" returned: 0 in 0.356s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.060s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2007323251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f3813b-0d58-4065-bb6b-ab8ce8cbfba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:39Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Creating volume 39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:39 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec66f4a-d047-44fa-a4d6-c543815c9d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26c1413-4bec-48f9-9c8e-f6fac4171416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 1073741824 Sep 01 01:24:40 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:40 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Volume volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5 (d2ba13e5-9a86-4e3c-9972-a8694417ceb5): created successfully Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26c1413-4bec-48f9-9c8e-f6fac4171416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Flow 'volume_create_manager' (d0434d40-2b96-4d17-acce-bb2a8d174558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Flow 'volume_create_manager' (f0caadda-4f7d-4b7d-a4c4-b905dfa5fca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ba2553-15a5-4e91-b9bd-afa245c02e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ba2553-15a5-4e91-b9bd-afa245c02e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1211322164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1984995-36dd-4234-925f-a2d5f7f0185d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3246487108c84666879bde7894feee49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:40Z,use_quota=True,user_id='be1951a5e8ef447a8e3e94c7a5289d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55be7fa6-e4ca-4075-80a2-86ea92f67f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55be7fa6-e4ca-4075-80a2-86ea92f67f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38e0682-b8ec-40f7-8fdb-e9132b519016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38e0682-b8ec-40f7-8fdb-e9132b519016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1984995-36dd-4234-925f-a2d5f7f0185d', 'volume_name': 'volume-d1984995-36dd-4234-925f-a2d5f7f0185d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0307d4da-509a-475f-9332-04228ef56d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0307d4da-509a-475f-9332-04228ef56d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939d3383-3130-4c5c-bd7c-b00b14d9961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Volume d1984995-36dd-4234-925f-a2d5f7f0185d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1984995-36dd-4234-925f-a2d5f7f0185d', 'volume_size': 1} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:40 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-bc984202-d5f9-47fd-bf06-64bb5fb71416 tempest-CreateVolumesFromImageTest-2132506914 None] Created volume successfully. Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Flow 'volume_create_manager' (75908944-2eaa-4bf8-a35e-23e3b4057395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31025ab5-09ce-4fc0-b112-53721c80d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31025ab5-09ce-4fc0-b112-53721c80d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-736259150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa811d2-cf4d-4d67-bf2d-231b34eee5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3246487108c84666879bde7894feee49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:41Z,use_quota=True,user_id='be1951a5e8ef447a8e3e94c7a5289d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:40 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f64f25-f23d-47fe-9c3c-b31016c44e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f64f25-f23d-47fe-9c3c-b31016c44e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a01e36-069a-4815-bbf6-aed569393d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a01e36-069a-4815-bbf6-aed569393d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa811d2-cf4d-4d67-bf2d-231b34eee5e6', 'volume_name': 'volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d04322-7507-4148-baa8-8c56a238d59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d04322-7507-4148-baa8-8c56a238d59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab12bf6-4fc5-4378-8e43-c834d14f07ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Volume 3aa811d2-cf4d-4d67-bf2d-231b34eee5e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6', 'volume_size': 1} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 1073741824" returned: 0 in 0.680s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:40 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 Sep 01 01:24:40 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:40 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7" returned: 0 in 0.246s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.712s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1312331147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a355eb6-83e0-48a1-93eb-f90ba9dccde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3246487108c84666879bde7894feee49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:39Z,use_quota=True,user_id='be1951a5e8ef447a8e3e94c7a5289d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Creating volume 2a355eb6-83e0-48a1-93eb-f90ba9dccde1 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:40 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5bd953b-d803-4e0e-a5d3-8234430a1418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:40 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1 1073741824 Sep 01 01:24:40 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:40 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b7f94c-c382-48f0-aff9-270485d9209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:40 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 (39f3813b-0d58-4065-bb6b-ab8ce8cbfba7): created successfully Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b7f94c-c382-48f0-aff9-270485d9209f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (e060fa06-0cd2-4b0d-8243-115f02f66b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:41 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-34f3e5c6-0cd4-461d-822a-5e5a29d96a6b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created volume successfully. Sep 01 01:24:41 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1 1073741824" returned: 0 in 0.474s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:41 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1 Sep 01 01:24:41 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:41 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1" returned: 0 in 0.308s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.279s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1128506057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4e22a1-88a7-4918-8f58-0a6614282577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:39Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Creating volume 3b4e22a1-88a7-4918-8f58-0a6614282577 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:41 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c0fb95-78f3-42bc-a24a-bc8ef66272a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd2289f-bdaf-4bf0-a379-d733abc69d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:41 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577 1073741824 Sep 01 01:24:41 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:41 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Volume volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1 (2a355eb6-83e0-48a1-93eb-f90ba9dccde1): created successfully Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd2289f-bdaf-4bf0-a379-d733abc69d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:41 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Flow 'volume_create_manager' (7ef05cf5-2976-44b4-8119-63f1bf4961b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:41 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-896c95da-6028-4fa8-88ca-039d5a9b647e tempest-CreateVolumesFromImageTest-2132506914 None] Created volume successfully. Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:42 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577 1073741824" returned: 0 in 0.612s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:42 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577 Sep 01 01:24:42 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:42 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577" returned: 0 in 0.335s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.042s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266116079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bbbfa4-0fc7-478d-94b8-e799391fccfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3246487108c84666879bde7894feee49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:40Z,use_quota=True,user_id='be1951a5e8ef447a8e3e94c7a5289d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Creating volume c6bbbfa4-0fc7-478d-94b8-e799391fccfb {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:42 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:42 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb 1073741824 Sep 01 01:24:42 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e7306b-d30b-47f8-9f32-6a3f57c70fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4e22a1-88a7-4918-8f58-0a6614282577', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910c3eef-404b-479e-8ab4-7e3868cf01ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:42 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume volume-3b4e22a1-88a7-4918-8f58-0a6614282577 (3b4e22a1-88a7-4918-8f58-0a6614282577): created successfully Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910c3eef-404b-479e-8ab4-7e3868cf01ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:42 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (165ca764-d2ed-470d-8f17-cefacf18b411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:42 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-12777066-2a5f-489f-89f1-7a36defaefb1 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created volume successfully. Sep 01 01:24:43 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb 1073741824" returned: 0 in 0.551s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:43 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb Sep 01 01:24:43 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Flow 'volume_create_manager' (fb76cd07-11aa-486f-bf57-79e5aa709800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e7cd06-0ac9-4993-afa9-f3e3c0126af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e7cd06-0ac9-4993-afa9-f3e3c0126af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3b53b7-30a4-446e-8493-111df19f0eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ea1a0638348f98b96c0cd2021bc16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:44Z,use_quota=True,user_id='8201256209234fe0baeb52622add05f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3ccd072-ecf4-489c-96b1-fb92b95cc336),volume_type_id=d3ccd072-ecf4-489c-96b1-fb92b95cc336)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0000016-6aeb-4e5e-8c12-5ca861f4694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0000016-6aeb-4e5e-8c12-5ca861f4694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07165906-fc05-41f0-8e9a-faab5aef59bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:43 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.image.glance [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Creating Keystone auth plugin from conf {{(pid=87064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb" returned: 0 in 0.289s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.460s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1211322164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1984995-36dd-4234-925f-a2d5f7f0185d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3246487108c84666879bde7894feee49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:40Z,use_quota=True,user_id='be1951a5e8ef447a8e3e94c7a5289d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Creating volume d1984995-36dd-4234-925f-a2d5f7f0185d {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:43 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389629df-1c27-420b-ab5e-d139d312d8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00eeb105-3d12-4990-9097-61d2aa613d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:43 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d 1073741824 Sep 01 01:24:43 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:43 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Volume volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb (c6bbbfa4-0fc7-478d-94b8-e799391fccfb): created successfully Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00eeb105-3d12-4990-9097-61d2aa613d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:43 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Flow 'volume_create_manager' (c8dd34b8-8c55-4193-a1c8-0dd88b8cf524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:43 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2f214cb5-30ba-4443-9782-802a7a5005be tempest-CreateVolumesFromImageTest-2132506914 None] Created volume successfully. Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07165906-fc05-41f0-8e9a-faab5aef59bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db3b53b7-30a4-446e-8493-111df19f0eae', 'volume_name': 'volume-db3b53b7-30a4-446e-8493-111df19f0eae', 'volume_size': 1, 'image_id': 'ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eec38c1376d0451fc89048de6f387c60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af0ea1a0638348f98b96c0cd2021bc16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4fa4c082b93421e28ba3015d1ab2e1fb608d6b1504810d0ac973e2139888e223e7009f14eac34af30db57977e043c9606eaa1a087bc2358bffa6a555c332f369', 'id': 'ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'created_at': datetime.datetime(2026, 8, 31, 23, 24, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 24, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea116e32-27c4-42b9-8800-6c58a3df7d8e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dad31bd-bd6e-4974-995a-7c36b8ea0a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dad31bd-bd6e-4974-995a-7c36b8ea0a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e076a8f-f317-4137-82a5-3fc0f70f2eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:44 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Volume db3b53b7-30a4-446e-8493-111df19f0eae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db3b53b7-30a4-446e-8493-111df19f0eae', 'volume_size': 1, 'image_id': 'ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eec38c1376d0451fc89048de6f387c60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af0ea1a0638348f98b96c0cd2021bc16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4fa4c082b93421e28ba3015d1ab2e1fb608d6b1504810d0ac973e2139888e223e7009f14eac34af30db57977e043c9606eaa1a087bc2358bffa6a555c332f369', 'id': 'ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'created_at': datetime.datetime(2026, 8, 31, 23, 24, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 24, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea116e32-27c4-42b9-8800-6c58a3df7d8e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Trying to clone db3b53b7-30a4-446e-8493-111df19f0eae from image ea116e32-27c4-42b9-8800-6c58a3df7d8e at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'metadata': {}}]). {{(pid=87064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:24:44 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Image download 0.00 MB at 0.00 MB/s Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17d4b72-9595-40c1-9196-deb51f06c67f]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:44 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD Sep 01 01:24:44 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:44 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d 1073741824" returned: 0 in 0.754s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (46972fda-d63a-4a20-b11b-f1fcc787b07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9896769c-3688-4ed5-81b1-69b42843c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9896769c-3688-4ed5-81b1-69b42843c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-903773463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fec8c9-2ffd-45c3-ac1b-81deaaae5036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:44Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e26af21-5b4f-4751-897a-67e11e258a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e26af21-5b4f-4751-897a-67e11e258a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6675586-2cd5-4dfd-8045-29ed2617663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:44 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6675586-2cd5-4dfd-8045-29ed2617663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9fec8c9-2ffd-45c3-ac1b-81deaaae5036', 'volume_name': 'volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e80aa49-c256-4ec2-a0d0-0be64f634f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e80aa49-c256-4ec2-a0d0-0be64f634f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f658766-ac45-490b-acbf-868ccd8dadbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:44 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume e9fec8c9-2ffd-45c3-ac1b-81deaaae5036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036', 'volume_size': 1} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:44 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d Sep 01 01:24:44 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:44 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD Sep 01 01:24:44 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:44 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (61bb546e-d12b-4f60-8b5e-977d3a957336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:45 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a958c9ee-fc3e-489d-83dd-9384048e080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d" returned: 0 in 0.367s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.388s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-736259150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa811d2-cf4d-4d67-bf2d-231b34eee5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3246487108c84666879bde7894feee49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:41Z,use_quota=True,user_id='be1951a5e8ef447a8e3e94c7a5289d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Creating volume 3aa811d2-cf4d-4d67-bf2d-231b34eee5e6 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:45 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a958c9ee-fc3e-489d-83dd-9384048e080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400515817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d82110b-78e4-4dc8-9534-6fd41f2ac9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:45Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec4b356-cbff-4a6a-a2f6-416d7b173906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec4b356-cbff-4a6a-a2f6-416d7b173906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf520309-014c-4b53-b208-20af0d57fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:45 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6 1073741824 Sep 01 01:24:45 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf520309-014c-4b53-b208-20af0d57fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d82110b-78e4-4dc8-9534-6fd41f2ac9eb', 'volume_name': 'volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56af6b89-0e5a-41a9-aa72-e5e06b1b58e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56af6b89-0e5a-41a9-aa72-e5e06b1b58e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5ce1e6-974f-4b73-9df4-bde8c0af0c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:45 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume 9d82110b-78e4-4dc8-9534-6fd41f2ac9eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb', 'volume_size': 1} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939d3383-3130-4c5c-bd7c-b00b14d9961c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1984995-36dd-4234-925f-a2d5f7f0185d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5aad3c-57b9-4c9a-8564-ca76c393fb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:45 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Volume volume-d1984995-36dd-4234-925f-a2d5f7f0185d (d1984995-36dd-4234-925f-a2d5f7f0185d): created successfully Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5aad3c-57b9-4c9a-8564-ca76c393fb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Flow 'volume_create_manager' (f0caadda-4f7d-4b7d-a4c4-b905dfa5fca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:45 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD" returned: 1 in 0.541s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Temporary image ea116e32-27c4-42b9-8800-6c58a3df7d8e is fetched for user 8201256209234fe0baeb52622add05f5. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:24:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-56955011-6033-475d-b3a6-293b613382ab tempest-CreateVolumesFromImageTest-2132506914 None] Created volume successfully. Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5056ae-387b-40d5-80f4-1916b0783d92]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:45 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD Sep 01 01:24:45 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (beaa1052-1d86-4337-a043-e62943c0708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2643532-1e0b-4acd-a826-a32d222cc2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2643532-1e0b-4acd-a826-a32d222cc2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546676319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8950d8ae-7aea-4da1-a144-d7dee0ba1d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:46Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78258d66-78d6-4627-8d20-4530444df0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78258d66-78d6-4627-8d20-4530444df0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796294b3-daa2-449b-9fa4-f913b863d717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796294b3-daa2-449b-9fa4-f913b863d717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8950d8ae-7aea-4da1-a144-d7dee0ba1d37', 'volume_name': 'volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95565daa-9eb7-4d13-a43f-3bb400000d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95565daa-9eb7-4d13-a43f-3bb400000d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a3279e-2ad7-40a1-af85-7d0b04f0db61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:45 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume 8950d8ae-7aea-4da1-a144-d7dee0ba1d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37', 'volume_size': 1} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:45 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6 1073741824" returned: 0 in 0.684s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:45 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:45 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6 Sep 01 01:24:45 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:45 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD Sep 01 01:24:45 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (1fc6ad0f-49f2-404d-bf42-5534f9fd265a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2157f37-e71c-4110-b2b7-f672c43d1863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2157f37-e71c-4110-b2b7-f672c43d1863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-669278989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d49c3f-d563-4ef6-b094-05ea6f669a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:46Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e57705-ab5c-405d-ba23-8aa329a275ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e57705-ab5c-405d-ba23-8aa329a275ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4cc8da-1dd2-4a67-88c0-278f2514ed36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4cc8da-1dd2-4a67-88c0-278f2514ed36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d49c3f-d563-4ef6-b094-05ea6f669a25', 'volume_name': 'volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13b498b-8be1-4a95-ad7a-3c07b3a09485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13b498b-8be1-4a95-ad7a-3c07b3a09485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6597a3-99df-4ec5-8d1f-e735232a2068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:46 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume e8d49c3f-d563-4ef6-b094-05ea6f669a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25', 'volume_size': 1} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:46 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6" returned: 0 in 0.471s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:46 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.977s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD" returned: 1 in 0.470s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Creating offline snapshot 8e6794df-ccbd-4566-95b6-554a871f85fd of volume 39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab12bf6-4fc5-4378-8e43-c834d14f07ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183cc8f8-1a4b-4a93-a72f-3e80b923da0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3baddd8-945c-4dd8-b0f9-7af2d4707f49]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:46 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Volume volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6 (3aa811d2-cf4d-4d67-bf2d-231b34eee5e6): created successfully Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183cc8f8-1a4b-4a93-a72f-3e80b923da0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Flow 'volume_create_manager' (75908944-2eaa-4bf8-a35e-23e3b4057395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:46 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-821052a1-1832-415e-9813-a4ecec7480cf tempest-CreateVolumesFromImageTest-2132506914 None] Created volume successfully. Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:46 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 Sep 01 01:24:46 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (8c1f2b53-b6a7-4d51-bccb-7ca815b22a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00454d25-d1e4-4dc0-b105-83b2e64b2273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00454d25-d1e4-4dc0-b105-83b2e64b2273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-434033173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19e0946-35ad-4a97-bb6f-d6928eb1fb2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:46Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11faea2-024e-4012-ba06-d1677fc3a839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11faea2-024e-4012-ba06-d1677fc3a839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b55f1ab-debf-4f76-8881-26125f81a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b55f1ab-debf-4f76-8881-26125f81a107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19e0946-35ad-4a97-bb6f-d6928eb1fb2a', 'volume_name': 'volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d35721-ed28-49b3-ad55-73d10a32051b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d35721-ed28-49b3-ad55-73d10a32051b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7153c30-12ac-4235-bc60-a51e04f08b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:46 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume a19e0946-35ad-4a97-bb6f-d6928eb1fb2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a', 'volume_size': 1} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:46 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7" returned: 0 in 0.457s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:46 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd 1G Sep 01 01:24:46 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:47 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd 1G" returned: 0 in 0.433s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:47 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd Sep 01 01:24:47 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "cinder-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "cinder-quobyte-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-quobyte-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[976f378e-3cb1-4cdb-86d5-2a689bc607f5]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:47 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd" returned: 0 in 0.369s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:47 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd is being set with open permissions: ugo+rw Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:47 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd Sep 01 01:24:47 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:47 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6 Sep 01 01:24:47 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:47 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd" returned: 0 in 0.311s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:47 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6" returned: 0 in 0.442s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:47 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6 Sep 01 01:24:47 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:48 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.info Sep 01 01:24:48 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:48 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6" returned: 0 in 0.308s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:48 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.info" returned: 0 in 0.260s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:48 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.info is being set with open permissions: ugo+rw Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-quobyte-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6" released by "delete_volume" :: held 0.809s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:48 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.info Sep 01 01:24:48 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Created reservations ['308fe531-741d-4b2c-890e-cacbb76e8a01', '40f5fcef-4a72-440d-a8db-d7fd9ecd269e', '6bb1b3c4-71e6-45c9-ba76-11cf25ccd8ec', '21d77f18-347b-4a08-8d48-1224e9ae782d'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:48 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:48 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:48 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.info" returned: 0 in 0.292s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.968s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-903773463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fec8c9-2ffd-45c3-ac1b-81deaaae5036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:44Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Creating volume e9fec8c9-2ffd-45c3-ac1b-81deaaae5036 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:48 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "cinder-d1984995-36dd-4234-925f-a2d5f7f0185d-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:48 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036 1073741824 Sep 01 01:24:48 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:48 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-93d3dde4-f1c3-4185-af3b-d23db2c61fc2 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Create snapshot completed successfully Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-d1984995-36dd-4234-925f-a2d5f7f0185d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "cinder-quobyte-d1984995-36dd-4234-925f-a2d5f7f0185d" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-quobyte-d1984995-36dd-4234-925f-a2d5f7f0185d" acquired by "delete_volume" :: waited 0.012s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:48 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.315s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:48 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Deleted volume successfully. Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae43e1c7-52c4-4b35-96d5-507a387f44aa]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:48 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-277090fb-6488-4769-a19e-437b51c1649e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-3aa811d2-cf4d-4d67-bf2d-231b34eee5e6-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:48 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d Sep 01 01:24:48 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:49 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036 1073741824" returned: 0 in 0.515s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:49 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d" returned: 0 in 0.431s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:49 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036 Sep 01 01:24:49 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:49 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d Sep 01 01:24:49 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:49 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036" returned: 0 in 0.271s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.333s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400515817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d82110b-78e4-4dc8-9534-6fd41f2ac9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:45Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Creating volume 9d82110b-78e4-4dc8-9534-6fd41f2ac9eb {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:49 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:49 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d1984995-36dd-4234-925f-a2d5f7f0185d" returned: 0 in 0.276s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f658766-ac45-490b-acbf-868ccd8dadbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:49 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb 1073741824 Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac8430e-b8c8-4a23-a876-8556183dc008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:49 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-quobyte-d1984995-36dd-4234-925f-a2d5f7f0185d" released by "delete_volume" :: held 0.791s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:49 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036 (e9fec8c9-2ffd-45c3-ac1b-81deaaae5036): created successfully Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac8430e-b8c8-4a23-a876-8556183dc008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (46972fda-d63a-4a20-b11b-f1fcc787b07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:49 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6339de91-905c-4cb0-85fc-6f33a50db534 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created volume successfully. Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Created reservations ['2ee5b1f2-ecb3-42ba-9a75-d43c9ef60799', 'e094b7f1-18b6-4e46-b17a-4727674cc530', 'f2d7bb02-3589-4902-9730-7c7b93ca3b4c', '40c2e911-4a8d-4a7d-b13a-e0c92b44f0b6'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:49 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:49 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "cinder-c6bbbfa4-0fc7-478d-94b8-e799391fccfb-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-c6bbbfa4-0fc7-478d-94b8-e799391fccfb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "cinder-quobyte-c6bbbfa4-0fc7-478d-94b8-e799391fccfb" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-quobyte-c6bbbfa4-0fc7-478d-94b8-e799391fccfb" acquired by "delete_volume" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8751806e-8ac2-494b-ba3d-fbbf14c52956]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:50 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.385s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:50 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Deleted volume successfully. Sep 01 01:24:50 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb Sep 01 01:24:50 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5dee3955-9cc9-4bd8-8eee-cb8fe22a752e tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-d1984995-36dd-4234-925f-a2d5f7f0185d-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:50 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb 1073741824" returned: 0 in 0.722s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:50 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb Sep 01 01:24:50 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:50 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (aa8d4482-a54b-4b14-9d3a-f3a761b2a92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f98b75-667a-488a-9ac3-72f825c57c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb" returned: 0 in 0.593s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:50 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f98b75-667a-488a-9ac3-72f825c57c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1300397912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b8404f-0782-415f-9bcd-838296095d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:50Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:50 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03387a76-bfc3-45dd-8b54-7b362c3711dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03387a76-bfc3-45dd-8b54-7b362c3711dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23317376-8c88-49d7-85c3-3a8ecafa4ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23317376-8c88-49d7-85c3-3a8ecafa4ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b8404f-0782-415f-9bcd-838296095d28', 'volume_name': 'volume-46b8404f-0782-415f-9bcd-838296095d28', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a70034-0ecf-416b-9788-faa5cbaa1741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a70034-0ecf-416b-9788-faa5cbaa1741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340b0141-7849-40d7-87a7-61484bb568aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:50 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume 46b8404f-0782-415f-9bcd-838296095d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b8404f-0782-415f-9bcd-838296095d28', 'volume_size': 1} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:50 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb" returned: 0 in 0.389s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.947s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546676319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8950d8ae-7aea-4da1-a144-d7dee0ba1d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:46Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Creating volume 8950d8ae-7aea-4da1-a144-d7dee0ba1d37 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:50 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5ce1e6-974f-4b73-9df4-bde8c0af0c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:50 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37 1073741824 Sep 01 01:24:50 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9aa0d0a-6749-4bdf-83e6-2fa1d91de0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:50 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb (9d82110b-78e4-4dc8-9534-6fd41f2ac9eb): created successfully Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9aa0d0a-6749-4bdf-83e6-2fa1d91de0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (61bb546e-d12b-4f60-8b5e-977d3a957336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:50 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ad4a44b9-8999-477a-a882-8f86e18af810 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created volume successfully. Sep 01 01:24:50 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c6bbbfa4-0fc7-478d-94b8-e799391fccfb" returned: 0 in 0.339s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:50 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-quobyte-c6bbbfa4-0fc7-478d-94b8-e799391fccfb" released by "delete_volume" :: held 1.014s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Created reservations ['df5c6737-90bf-4d6c-bac1-3fc60bf420c2', '0ed015d1-fa6d-4aeb-bef2-0ebc0c067061', '1f30aa7e-d5ee-4d46-9f42-dd3743d40dbe', 'e636ea4d-9548-4fb7-9ecb-e5a108d07384'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (053241eb-0cc6-4005-a081-eb94dc33491e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c810ff8b-b3c0-42cb-8c86-3b37e8065a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c810ff8b-b3c0-42cb-8c86-3b37e8065a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1943647985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef06ffd2-de44-45ec-909a-ce6d2703fe57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:51Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d29599f-4ac5-4ebe-9526-f729e80bf16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d29599f-4ac5-4ebe-9526-f729e80bf16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe408a35-b49e-481f-9069-af130d7c95b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe408a35-b49e-481f-9069-af130d7c95b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef06ffd2-de44-45ec-909a-ce6d2703fe57', 'volume_name': 'volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31ce711-d979-45f4-bdbd-410fdfd2f0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31ce711-d979-45f4-bdbd-410fdfd2f0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8376ae7-9af0-48e1-9879-5679c4f80d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:51 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume ef06ffd2-de44-45ec-909a-ce6d2703fe57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57', 'volume_size': 1} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:51 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:51 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:51 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37 1073741824" returned: 0 in 0.700s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:51 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37 Sep 01 01:24:51 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:51 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.353s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:51 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Deleted volume successfully. Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d5e05318-e140-4626-9f13-2a4d80985310 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-c6bbbfa4-0fc7-478d-94b8-e799391fccfb-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (43b4400e-5ca0-437d-8bc4-016fb71ef9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a0b18b-9c33-4afb-88b5-991bc8493bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a0b18b-9c33-4afb-88b5-991bc8493bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295150009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c8d37e-030d-47db-b325-ca15ce9b9981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:52Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75203176-fae1-47d5-ba84-1adfbd08dc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75203176-fae1-47d5-ba84-1adfbd08dc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ea69ed-0430-4b98-9dd3-660db88644fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ea69ed-0430-4b98-9dd3-660db88644fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c8d37e-030d-47db-b325-ca15ce9b9981', 'volume_name': 'volume-94c8d37e-030d-47db-b325-ca15ce9b9981', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac97dfa-64ad-4dfd-95a8-6815f61e4398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac97dfa-64ad-4dfd-95a8-6815f61e4398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bd0f21-1ee0-4be3-81f2-6cd0fa1dd21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:51 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume 94c8d37e-030d-47db-b325-ca15ce9b9981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c8d37e-030d-47db-b325-ca15ce9b9981', 'volume_size': 1} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:51 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37" returned: 0 in 0.373s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.534s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-669278989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d49c3f-d563-4ef6-b094-05ea6f669a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:46Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Creating volume e8d49c3f-d563-4ef6-b094-05ea6f669a25 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:51 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a3279e-2ad7-40a1-af85-7d0b04f0db61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b97feb-4ee3-49cc-ba2c-2a402eea6e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:51 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25 1073741824 Sep 01 01:24:51 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:51 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37 (8950d8ae-7aea-4da1-a144-d7dee0ba1d37): created successfully Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b97feb-4ee3-49cc-ba2c-2a402eea6e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:51 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (beaa1052-1d86-4337-a043-e62943c0708d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:51 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c623784c-77f7-499b-a0ec-8abbda585fec tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created volume successfully. Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (a851152b-3e1c-4377-b3c9-74bfc0e06135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2014589a-b09c-454f-9aa8-542d979daa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "cinder-2a355eb6-83e0-48a1-93eb-f90ba9dccde1-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2014589a-b09c-454f-9aa8-542d979daa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1502101235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61565e5-d40e-4f54-8016-11b023497ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:52Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9739c65e-7394-472d-aa95-c3398a2b4084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9739c65e-7394-472d-aa95-c3398a2b4084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b4cecc-06ac-49d3-b353-fefc1a7e07e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b4cecc-06ac-49d3-b353-fefc1a7e07e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61565e5-d40e-4f54-8016-11b023497ec5', 'volume_name': 'volume-f61565e5-d40e-4f54-8016-11b023497ec5', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584bd4a4-ceda-4ad5-ae0e-82442324d4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584bd4a4-ceda-4ad5-ae0e-82442324d4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed9a39a-d22e-42fa-b537-9496aa308ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume f61565e5-d40e-4f54-8016-11b023497ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61565e5-d40e-4f54-8016-11b023497ec5', 'volume_size': 1} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-2a355eb6-83e0-48a1-93eb-f90ba9dccde1-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "cinder-quobyte-2a355eb6-83e0-48a1-93eb-f90ba9dccde1" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-quobyte-2a355eb6-83e0-48a1-93eb-f90ba9dccde1" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5814b8f9-683c-44c6-8aad-487747ffacdc]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:52 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1 Sep 01 01:24:52 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:52 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25 1073741824" returned: 0 in 0.730s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:52 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25 Sep 01 01:24:52 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (d9350813-3d6c-4bfb-8b1c-6810b763135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7035933-9464-4ab5-b4d0-93ce2b87d379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7035933-9464-4ab5-b4d0-93ce2b87d379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1157599266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f08c14b-e300-40b4-9124-dedf15c8b9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:53Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10b1973-113e-4d0b-9737-76d9695d3b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10b1973-113e-4d0b-9737-76d9695d3b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf86387b-9d07-4ea0-98ea-ef8c04b27aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf86387b-9d07-4ea0-98ea-ef8c04b27aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f08c14b-e300-40b4-9124-dedf15c8b9a9', 'volume_name': 'volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b353aca-2cef-4d6b-a1d4-92d5a51fad4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b353aca-2cef-4d6b-a1d4-92d5a51fad4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe515e3-b8d6-42dd-aa9f-b281e96af04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume 8f08c14b-e300-40b4-9124-dedf15c8b9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9', 'volume_size': 1} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:52 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:52 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:52 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1" returned: 0 in 0.445s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:52 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1 Sep 01 01:24:52 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:52 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25" returned: 0 in 0.306s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.586s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3b53b7-30a4-446e-8493-111df19f0eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0ea1a0638348f98b96c0cd2021bc16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:44Z,use_quota=True,user_id='8201256209234fe0baeb52622add05f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3ccd072-ecf4-489c-96b1-fb92b95cc336),volume_type_id=d3ccd072-ecf4-489c-96b1-fb92b95cc336)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Creating volume db3b53b7-30a4-446e-8493-111df19f0eae {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:52 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6597a3-99df-4ec5-8d1f-e735232a2068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:52 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae 1073741824 Sep 01 01:24:52 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1432d227-5177-4704-96a9-f86e0b93504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:52 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25 (e8d49c3f-d563-4ef6-b094-05ea6f669a25): created successfully Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1432d227-5177-4704-96a9-f86e0b93504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:52 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (1fc6ad0f-49f2-404d-bf42-5534f9fd265a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:53 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-dc36e6aa-139c-411b-aa15-6b28512e4228 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created volume successfully. Sep 01 01:24:53 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.336s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:24:53 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-2a355eb6-83e0-48a1-93eb-f90ba9dccde1" returned: 0 in 0.369s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-quobyte-2a355eb6-83e0-48a1-93eb-f90ba9dccde1" released by "delete_volume" :: held 0.868s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Created reservations ['ef256310-3279-40fa-81ae-772ccf5a884c', '30e89860-63be-42bc-b3b0-cbc418eed2b6', 'b197be6f-080c-41aa-a099-1a23f64b02e2', '40c301d7-95ce-403a-bb0d-625a12e9289c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:53 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:53 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "cinder-d2ba13e5-9a86-4e3c-9972-a8694417ceb5-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:53 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae 1073741824" returned: 0 in 0.634s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-d2ba13e5-9a86-4e3c-9972-a8694417ceb5-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "cinder-quobyte-d2ba13e5-9a86-4e3c-9972-a8694417ceb5" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-quobyte-d2ba13e5-9a86-4e3c-9972-a8694417ceb5" acquired by "delete_volume" :: waited 0.032s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:53 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:53 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae Sep 01 01:24:53 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.294s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:53 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Deleted volume successfully. Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b35ea3-70eb-441f-ade4-ee1641e603b0]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-64acd624-2d98-4d96-8bd6-6142d9eabfb2 tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-2a355eb6-83e0-48a1-93eb-f90ba9dccde1-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:53 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5 Sep 01 01:24:53 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:53 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae" returned: 0 in 0.265s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.314s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-434033173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19e0946-35ad-4a97-bb6f-d6928eb1fb2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59fc52654f240d38dadd0c75250707b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:46Z,use_quota=True,user_id='0ed932f5ac3442d386bcbf59af206510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Creating volume a19e0946-35ad-4a97-bb6f-d6928eb1fb2a {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:53 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:53 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a 1073741824 Sep 01 01:24:53 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:53 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Attempting download of ea116e32-27c4-42b9-8800-6c58a3df7d8e ((None, [{'url': 'file:///opt/stack/data/glance/images/ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'metadata': {}}])) to volume db3b53b7-30a4-446e-8493-111df19f0eae. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf3ef1b-d0d2-4283-8ddc-dd3c7d1e7647]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea116e32-27c4-42b9-8800-6c58a3df7d8e_0gn3itko {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:54 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5" returned: 0 in 0.425s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:54 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea116e32-27c4-42b9-8800-6c58a3df7d8e_0gn3itko Sep 01 01:24:54 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:54 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5 Sep 01 01:24:54 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:54 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:54 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea116e32-27c4-42b9-8800-6c58a3df7d8e_0gn3itko" returned: 0 in 0.371s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea116e32-27c4-42b9-8800-6c58a3df7d8e_0gn3itko {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:54 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-d2ba13e5-9a86-4e3c-9972-a8694417ceb5" returned: 0 in 0.277s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a 1073741824" returned: 0 in 0.491s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-quobyte-d2ba13e5-9a86-4e3c-9972-a8694417ceb5" released by "delete_volume" :: held 0.773s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:54 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a Sep 01 01:24:54 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Created reservations ['1a698d5d-1af5-4a15-963b-a1d542280325', '9b8bfa00-7131-47be-9191-3676b4207a81', 'edd3dcdc-0ddb-491a-90d1-1b3e43843082', 'f65bb396-251d-453e-ad74-0db7577f1634'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:54 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea116e32-27c4-42b9-8800-6c58a3df7d8e_0gn3itko Sep 01 01:24:54 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:54 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:54 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:54 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea116e32-27c4-42b9-8800-6c58a3df7d8e_0gn3itko" returned: 1 in 0.384s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea116e32-27c4-42b9-8800-6c58a3df7d8e_0gn3itko' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d10a62-fc95-44de-8120-272cef41825e]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:54 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a" returned: 0 in 0.338s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.186s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1300397912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b8404f-0782-415f-9bcd-838296095d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:50Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Creating volume 46b8404f-0782-415f-9bcd-838296095d28 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:54 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7153c30-12ac-4235-bc60-a51e04f08b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b88ac71-b279-4d29-ae57-7278e8dfd9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:54 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28 1073741824 Sep 01 01:24:54 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:54 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:54 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Volume volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a (a19e0946-35ad-4a97-bb6f-d6928eb1fb2a): created successfully Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b88ac71-b279-4d29-ae57-7278e8dfd9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Flow 'volume_create_manager' (8c1f2b53-b6a7-4d51-bccb-7ca815b22a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.333s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Deleted volume successfully. Sep 01 01:24:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a21a503d-e935-4566-b506-52b490447504 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created volume successfully. Sep 01 01:24:54 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD Sep 01 01:24:54 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a9f43de-8161-43b4-8864-20f5b0ef092d tempest-CreateVolumesFromImageTest-2132506914 None] Lock "cinder-d2ba13e5-9a86-4e3c-9972-a8694417ceb5-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:55 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:55 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD Sep 01 01:24:55 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:55 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28 1073741824" returned: 0 in 0.607s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:55 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28 Sep 01 01:24:55 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:55 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD" returned: 1 in 0.417s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] ea116e32-27c4-42b9-8800-6c58a3df7d8e was raw, converting to qcow2 {{(pid=87064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:55 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae Sep 01 01:24:55 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-quobyte-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a" acquired by "delete_volume" :: waited 0.034s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64086ea-518d-4be1-884b-d134277839a1]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:55 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28" returned: 0 in 0.403s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.683s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1943647985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef06ffd2-de44-45ec-909a-ce6d2703fe57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:51Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Creating volume ef06ffd2-de44-45ec-909a-ce6d2703fe57 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:55 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340b0141-7849-40d7-87a7-61484bb568aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b8404f-0782-415f-9bcd-838296095d28', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:55 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57 1073741824 Sep 01 01:24:55 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18805f13-c768-4b39-91c9-2d76b83f5df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:55 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume volume-46b8404f-0782-415f-9bcd-838296095d28 (46b8404f-0782-415f-9bcd-838296095d28): created successfully Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18805f13-c768-4b39-91c9-2d76b83f5df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (aa8d4482-a54b-4b14-9d3a-f3a761b2a92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:55 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a Sep 01 01:24:55 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0b07fc65-a52f-41b6-95c3-24896068d17b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created volume successfully. Sep 01 01:24:56 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae" returned: 0 in 0.585s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea116e32-27c4-42b9-8800-6c58a3df7d8e_je0hw0y5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:24:56 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:56 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae 1G Sep 01 01:24:56 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:56 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a" returned: 0 in 0.456s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:56 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a Sep 01 01:24:56 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:56 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57 1073741824" returned: 0 in 0.585s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:56 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57 Sep 01 01:24:56 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:56 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a" returned: 0 in 0.340s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a" released by "delete_volume" :: held 0.857s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:56 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae 1G" returned: 0 in 0.458s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Downloaded image ea116e32-27c4-42b9-8800-6c58a3df7d8e ((None, [{'url': 'file:///opt/stack/data/glance/images/ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'metadata': {}}])) to volume db3b53b7-30a4-446e-8493-111df19f0eae successfully. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Temporary image ea116e32-27c4-42b9-8800-6c58a3df7d8e for user 8201256209234fe0baeb52622add05f5 is deleted. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Marking volume db3b53b7-30a4-446e-8493-111df19f0eae as bootable. {{(pid=87064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Copying metadata from image ea116e32-27c4-42b9-8800-6c58a3df7d8e to db3b53b7-30a4-446e-8493-111df19f0eae. {{(pid=87064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Creating volume glance metadata for volume db3b53b7-30a4-446e-8493-111df19f0eae backed by image ea116e32-27c4-42b9-8800-6c58a3df7d8e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'eec38c1376d0451fc89048de6f387c60', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created reservations ['3e06faa6-740e-463d-b503-506972f8aa2a', '442939b4-f779-4f84-a2f5-ab6660c9773d', '9b787b49-0217-43e6-9edb-1736d8b34e23', '52fc53e3-4a60-479b-bab5-86f8aafbf307'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e076a8f-f317-4137-82a5-3fc0f70f2eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3b53b7-30a4-446e-8493-111df19f0eae', 'volume_size': 1, 'image_id': 'ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eec38c1376d0451fc89048de6f387c60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af0ea1a0638348f98b96c0cd2021bc16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4fa4c082b93421e28ba3015d1ab2e1fb608d6b1504810d0ac973e2139888e223e7009f14eac34af30db57977e043c9606eaa1a087bc2358bffa6a555c332f369', 'id': 'ea116e32-27c4-42b9-8800-6c58a3df7d8e', 'created_at': datetime.datetime(2026, 8, 31, 23, 24, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 24, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea116e32-27c4-42b9-8800-6c58a3df7d8e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d2284b-28bb-4ab4-94a8-277444d7a6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:56 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57" returned: 0 in 0.373s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.138s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295150009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c8d37e-030d-47db-b325-ca15ce9b9981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:52Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Creating volume 94c8d37e-030d-47db-b325-ca15ce9b9981 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:56 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:56 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Volume volume-db3b53b7-30a4-446e-8493-111df19f0eae (db3b53b7-30a4-446e-8493-111df19f0eae): created successfully Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d2284b-28bb-4ab4-94a8-277444d7a6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Flow 'volume_create_manager' (fb76cd07-11aa-486f-bf57-79e5aa709800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:56 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981 1073741824 Sep 01 01:24:56 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8376ae7-9af0-48e1-9879-5679c4f80d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2705b684-35f7-4ae8-a148-b376836119db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:56 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-508ec75e-a2a8-481e-be95-d3da429c9393 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Created volume successfully. Sep 01 01:24:56 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57 (ef06ffd2-de44-45ec-909a-ce6d2703fe57): created successfully Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2705b684-35f7-4ae8-a148-b376836119db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (053241eb-0cc6-4005-a081-eb94dc33491e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-95c2c8c9-ed66-4151-807a-7ea5c25ba77b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created volume successfully. Sep 01 01:24:57 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:57 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:57 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.273s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Deleted volume successfully. Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-dd02de19-732e-4797-aeb3-2776d300a2f5 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-a19e0946-35ad-4a97-bb6f-d6928eb1fb2a-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:57 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981 1073741824" returned: 0 in 0.590s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:57 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981 Sep 01 01:24:57 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Acquiring lock "cinder-db3b53b7-30a4-446e-8493-111df19f0eae-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Lock "cinder-db3b53b7-30a4-446e-8493-111df19f0eae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:57 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Acquiring lock "cinder-quobyte-db3b53b7-30a4-446e-8493-111df19f0eae" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981" returned: 0 in 0.335s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.592s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1502101235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61565e5-d40e-4f54-8016-11b023497ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:52Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Creating volume f61565e5-d40e-4f54-8016-11b023497ec5 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:57 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bd0f21-1ee0-4be3-81f2-6cd0fa1dd21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c8d37e-030d-47db-b325-ca15ce9b9981', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a631d1d-e1b3-4fe9-81a1-babc79db14f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:57 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5 1073741824 Sep 01 01:24:57 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Lock "cinder-quobyte-db3b53b7-30a4-446e-8493-111df19f0eae" acquired by "delete_volume" :: waited 0.087s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-e8d49c3f-d563-4ef6-b094-05ea6f669a25-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[227a1909-b4b3-4e9b-b357-5927a3aa8704]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:58 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume volume-94c8d37e-030d-47db-b325-ca15ce9b9981 (94c8d37e-030d-47db-b325-ca15ce9b9981): created successfully Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a631d1d-e1b3-4fe9-81a1-babc79db14f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (43b4400e-5ca0-437d-8bc4-016fb71ef9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-e8d49c3f-d563-4ef6-b094-05ea6f669a25-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:58 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c91ea7fd-8b29-4201-af0b-e64c1de21aa8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created volume successfully. Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-quobyte-e8d49c3f-d563-4ef6-b094-05ea6f669a25" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-e8d49c3f-d563-4ef6-b094-05ea6f669a25" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[030cdd65-bb9d-4b32-b7ee-003cec0c6cca]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:58 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae Sep 01 01:24:58 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:58 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25 Sep 01 01:24:58 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:58 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5 1073741824" returned: 0 in 0.630s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:58 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5 Sep 01 01:24:58 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:58 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae" returned: 0 in 0.615s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:58 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae Sep 01 01:24:58 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:58 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25" returned: 0 in 0.543s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:58 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25 Sep 01 01:24:58 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Flow 'volume_create_manager' (0b534694-865e-47e1-a87e-3679e015b3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:58 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9260074-6267-4b19-8132-c0eb3cda93ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-db3b53b7-30a4-446e-8493-111df19f0eae" returned: 0 in 0.352s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:58 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Lock "cinder-quobyte-db3b53b7-30a4-446e-8493-111df19f0eae" released by "delete_volume" :: held 1.044s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5" returned: 0 in 0.428s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9260074-6267-4b19-8132-c0eb3cda93ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-822226787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8279dc71-91e2-4fc3-89b0-107271813dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa312ccd72d3439abcb52c9133bad5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:59Z,use_quota=True,user_id='68dee8bccaec43bbb632273fd16e7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a03b4f0-85b4-443a-9717-3c6d4130f37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a03b4f0-85b4-443a-9717-3c6d4130f37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094277d8-0622-449b-afec-afbed09241da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094277d8-0622-449b-afec-afbed09241da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8279dc71-91e2-4fc3-89b0-107271813dfa', 'volume_name': 'volume-8279dc71-91e2-4fc3-89b0-107271813dfa', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd11a9d-2bf4-48c9-8a4d-66531a610c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd11a9d-2bf4-48c9-8a4d-66531a610c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b070f68-ef8c-4831-8d04-27e8c8727158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:59 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Volume 8279dc71-91e2-4fc3-89b0-107271813dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8279dc71-91e2-4fc3-89b0-107271813dfa', 'volume_size': 1} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-822226787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8279dc71-91e2-4fc3-89b0-107271813dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa312ccd72d3439abcb52c9133bad5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:59Z,use_quota=True,user_id='68dee8bccaec43bbb632273fd16e7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Creating volume 8279dc71-91e2-4fc3-89b0-107271813dfa {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:59 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:59 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e8d49c3f-d563-4ef6-b094-05ea6f669a25" returned: 0 in 0.384s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:59 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa 1073741824 Sep 01 01:24:59 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed9a39a-d22e-42fa-b537-9496aa308ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61565e5-d40e-4f54-8016-11b023497ec5', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56a9d1e-cd0b-48e6-bd9f-9ae35d4cb387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-e8d49c3f-d563-4ef6-b094-05ea6f669a25" released by "delete_volume" :: held 1.028s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:59 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume volume-f61565e5-d40e-4f54-8016-11b023497ec5 (f61565e5-d40e-4f54-8016-11b023497ec5): created successfully Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56a9d1e-cd0b-48e6-bd9f-9ae35d4cb387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (a851152b-3e1c-4377-b3c9-74bfc0e06135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:24:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2ebfa659-e043-4522-80c7-1bf6730e4471 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created volume successfully. Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Created reservations ['c1dde553-1a16-4edb-ac78-91cf269fce9b', 'c608775e-3a39-4876-b421-2d6ecafb8022', '15ec5036-44fb-4bd7-972d-971ea3756439', 'eb34c59c-0277-46eb-9f11-62128e951e28'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created reservations ['f6ea61e3-03a2-4b08-aa30-59c4674af1ea', '743760b3-1c66-4e4b-8abb-de930294885d', 'ce2b7f89-c3fb-4267-8af6-35d3ddf1361b', 'd973ee79-e26a-461f-a3bb-34091ca2872e'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:59 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:59 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:59 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:24:59 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:59 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa 1073741824" returned: 0 in 0.533s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:59 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.303s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Deleted volume successfully. Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:59 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9bbe706c-8379-4877-9178-facea0900876 tempest-VolumeAndVolumeTypeFromImageTest-1480982609 None] Lock "cinder-db3b53b7-30a4-446e-8493-111df19f0eae-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:59 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa Sep 01 01:24:59 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.294s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:24:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Deleted volume successfully. Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-53a6ccc7-43a3-4a6e-9917-b4d4948af578 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-e8d49c3f-d563-4ef6-b094-05ea6f669a25-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:24:59 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa" returned: 0 in 0.275s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.225s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1157599266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f08c14b-e300-40b4-9124-dedf15c8b9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcc7e56bdd248d7b22f6895e1f3f3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:24:53Z,use_quota=True,user_id='93947ed6e7504fcb99a942546a102517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Creating volume 8f08c14b-e300-40b4-9124-dedf15c8b9a9 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:24:59 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b070f68-ef8c-4831-8d04-27e8c8727158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8279dc71-91e2-4fc3-89b0-107271813dfa', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:24:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15768f5b-bfec-4824-a8d5-74996c3401f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:24:59 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9 1073741824 Sep 01 01:24:59 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:00 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Volume volume-8279dc71-91e2-4fc3-89b0-107271813dfa (8279dc71-91e2-4fc3-89b0-107271813dfa): created successfully Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15768f5b-bfec-4824-a8d5-74996c3401f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Flow 'volume_create_manager' (0b534694-865e-47e1-a87e-3679e015b3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3ef8b29e-8e2f-4578-aea5-242d12e547d0 tempest-VolumeDependencyTests-669000491 None] Created volume successfully. Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-8950d8ae-7aea-4da1-a144-d7dee0ba1d37-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-8950d8ae-7aea-4da1-a144-d7dee0ba1d37-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-quobyte-8950d8ae-7aea-4da1-a144-d7dee0ba1d37" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-8950d8ae-7aea-4da1-a144-d7dee0ba1d37" acquired by "delete_volume" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5937b04-4f7b-4eaf-a0eb-e79d67d768ea]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:00 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37 Sep 01 01:25:00 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:00 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9 1073741824" returned: 0 in 0.565s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:00 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9 Sep 01 01:25:00 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:00 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37" returned: 0 in 0.409s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:00 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37 Sep 01 01:25:00 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:00 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9" returned: 0 in 0.290s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe515e3-b8d6-42dd-aa9f-b281e96af04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326cb567-e4c1-4837-9fa0-44bf7328908e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:00 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Volume volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9 (8f08c14b-e300-40b4-9124-dedf15c8b9a9): created successfully Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326cb567-e4c1-4837-9fa0-44bf7328908e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Flow 'volume_create_manager' (d9350813-3d6c-4bfb-8b1c-6810b763135a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-346358c4-79a3-4ee7-bbd9-ad72f0228ef8 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created volume successfully. Sep 01 01:25:01 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8950d8ae-7aea-4da1-a144-d7dee0ba1d37" returned: 0 in 0.321s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-8950d8ae-7aea-4da1-a144-d7dee0ba1d37" released by "delete_volume" :: held 0.789s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] Creating offline snapshot 1d9da356-3a41-4974-8ddb-15439edbd630 of volume 8279dc71-91e2-4fc3-89b0-107271813dfa {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created reservations ['040b1cbc-1fca-4000-acf7-9e4f1b9ea1b9', 'cfdb16a3-465b-4933-b47c-6fd8680a8e38', '58ea48b5-edef-4d88-8167-3b4492d3d2c3', '19a605d9-1d9b-408f-beeb-dd16f9642f17'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67e1d83-eb02-421a-8c3b-8886e3fabf5e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:01 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:01 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:01 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa Sep 01 01:25:01 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-quobyte-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:01 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.336s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb" acquired by "delete_volume" :: waited 0.029s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:01 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Deleted volume successfully. Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[472a9e24-e42e-4172-8ab2-e0255c3eee4f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8696b59d-0b42-4243-9dff-b4bf48ac5b36 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-8950d8ae-7aea-4da1-a144-d7dee0ba1d37-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:01 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa" returned: 0 in 0.528s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-8f08c14b-e300-40b4-9124-dedf15c8b9a9-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:01 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 1G Sep 01 01:25:01 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-8f08c14b-e300-40b4-9124-dedf15c8b9a9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:01 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb Sep 01 01:25:01 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-quobyte-8f08c14b-e300-40b4-9124-dedf15c8b9a9" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-8f08c14b-e300-40b4-9124-dedf15c8b9a9" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf2e468-7f84-49f6-b8b5-b3dda1660f2a]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:02 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9 Sep 01 01:25:02 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:02 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb" returned: 0 in 0.481s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:02 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb Sep 01 01:25:02 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:02 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 1G" returned: 0 in 0.592s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8279dc71-91e2-4fc3-89b0-107271813dfa -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:02 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8279dc71-91e2-4fc3-89b0-107271813dfa -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 Sep 01 01:25:02 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:02 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:02 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb" returned: 0 in 0.311s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9" returned: 0 in 0.538s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb" released by "delete_volume" :: held 0.853s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:02 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9 Sep 01 01:25:02 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created reservations ['84037614-fb33-4b09-b7fe-fa1b4109965b', 'd833156f-f5f2-44bd-9880-1b29d4452230', '31d2746c-7047-4ecb-bd1b-c8961cb0bc6a', '4c784967-8983-4cd7-953f-60e22396a2db'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:02 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:02 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:02 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8279dc71-91e2-4fc3-89b0-107271813dfa -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630" returned: 0 in 0.512s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:02 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 is being set with open permissions: ugo+rw Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:02 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 Sep 01 01:25:02 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-quobyte-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036" acquired by "delete_volume" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bd68ee-8fdf-4334-91da-4e0b37bb7977]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:03 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8f08c14b-e300-40b4-9124-dedf15c8b9a9" returned: 0 in 0.560s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-8f08c14b-e300-40b4-9124-dedf15c8b9a9" released by "delete_volume" :: held 1.183s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:03 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036 Sep 01 01:25:03 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:03 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.544s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:03 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Deleted volume successfully. Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created reservations ['d67dc38b-6347-4a1b-9e8f-f8ece51f9930', '4f7cd6be-e91f-4608-9af4-430aeddfb09b', '81733bde-ddb2-436c-a293-026e1f7813c4', 'b5988c18-7443-4599-84ad-f0036364032d'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-81ff7e63-01c1-4be7-9bb3-dc0e4432045f tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-9d82110b-78e4-4dc8-9534-6fd41f2ac9eb-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:03 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630" returned: 0 in 0.556s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:03 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:03 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:03 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.info Sep 01 01:25:03 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:03 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036" returned: 0 in 0.637s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:03 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036 Sep 01 01:25:03 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:03 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.327s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:03 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Deleted volume successfully. Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ddd5655f-84ed-4298-9962-7edca12ea676 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-8f08c14b-e300-40b4-9124-dedf15c8b9a9-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:03 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.info" returned: 0 in 0.348s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:03 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.info is being set with open permissions: ugo+rw Sep 01 01:25:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:03 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.info Sep 01 01:25:03 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:04 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036" returned: 0 in 0.375s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036" released by "delete_volume" :: held 1.081s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created reservations ['0b6bbd07-7d97-4ae3-91e7-ccf30772602b', '6e131e3c-1f04-4e50-a32c-2ff84082dd61', 'd858ec89-1e1f-4284-b99d-0935a6441b6f', '56fea778-60dd-4f0e-8e5c-bfe3c9d35410'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:04 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.info" returned: 0 in 0.303s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.975s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:04 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-eb77f10f-d1dc-4ae1-96a5-a7fc2cc81bc2 tempest-VolumeDependencyTests-669000491 None] Create snapshot completed successfully Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-f61565e5-d40e-4f54-8016-11b023497ec5-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-f61565e5-d40e-4f54-8016-11b023497ec5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:04 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:04 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-quobyte-f61565e5-d40e-4f54-8016-11b023497ec5" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-f61565e5-d40e-4f54-8016-11b023497ec5" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6208c80-8cb9-4911-86c7-1bf39bf15f86]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:04 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5 Sep 01 01:25:04 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:04 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.369s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:04 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Deleted volume successfully. Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0267c00b-2a4c-4885-8740-af65f602a375 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-e9fec8c9-2ffd-45c3-ac1b-81deaaae5036-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:04 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5" returned: 0 in 0.446s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:04 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5 Sep 01 01:25:04 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:04 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Flow 'volume_create_manager' (6277dff7-5707-4fa0-bfef-1c3638323134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e43f63-9263-4998-a9df-6f787b772caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e43f63-9263-4998-a9df-6f787b772caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-393258461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b4734d-0a73-4952-8be9-187ee3712006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa312ccd72d3439abcb52c9133bad5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1d9da356-3a41-4974-8ddb-15439edbd630,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:05Z,use_quota=True,user_id='68dee8bccaec43bbb632273fd16e7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa6bfb1-9856-46c8-aa54-55765401e229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa6bfb1-9856-46c8-aa54-55765401e229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6950d1d9-9778-4b62-9442-8314bd1431b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6950d1d9-9778-4b62-9442-8314bd1431b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f2b4734d-0a73-4952-8be9-187ee3712006', 'volume_name': 'volume-f2b4734d-0a73-4952-8be9-187ee3712006', 'volume_size': 1, 'snapshot_id': '1d9da356-3a41-4974-8ddb-15439edbd630'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad826f2-1554-4645-ad84-192f154adbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad826f2-1554-4645-ad84-192f154adbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:05 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d574f916-9fd0-472f-a6c6-b5112a37c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:05 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Volume f2b4734d-0a73-4952-8be9-187ee3712006: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f2b4734d-0a73-4952-8be9-187ee3712006', 'volume_size': 1, 'snapshot_id': '1d9da356-3a41-4974-8ddb-15439edbd630'} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f61565e5-d40e-4f54-8016-11b023497ec5" returned: 0 in 0.312s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-3b4e22a1-88a7-4918-8f58-0a6614282577-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Acquiring lock "cinder-quobyte-1d9da356-3a41-4974-8ddb-15439edbd630-f2b4734d-0a73-4952-8be9-187ee3712006" by "_create_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-f61565e5-d40e-4f54-8016-11b023497ec5" released by "delete_volume" :: held 0.828s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-3b4e22a1-88a7-4918-8f58-0a6614282577-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-1d9da356-3a41-4974-8ddb-15439edbd630-f2b4734d-0a73-4952-8be9-187ee3712006" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Creating volume f2b4734d-0a73-4952-8be9-187ee3712006 from snapshot 1d9da356-3a41-4974-8ddb-15439edbd630 {{(pid=87064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Acquiring lock "cinder-quobyte-f2b4734d-0a73-4952-8be9-187ee3712006" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-f2b4734d-0a73-4952-8be9-187ee3712006" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] snapshot: 1d9da356-3a41-4974-8ddb-15439edbd630, volume: f2b4734d-0a73-4952-8be9-187ee3712006, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "cinder-quobyte-3b4e22a1-88a7-4918-8f58-0a6614282577" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[378df848-9c83-4fa2-a936-f3fa12a367a5]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created reservations ['4f59ae4d-ce5d-4dc7-997a-efcfe17c1c99', 'b69a8472-e886-4752-b702-20e6cc98d9f0', '16fdf201-5248-4df4-ba2a-4b7bdafa8af5', '83a36de2-0c03-4f16-b090-babf0b4b41f8'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-3b4e22a1-88a7-4918-8f58-0a6614282577" acquired by "delete_volume" :: waited 0.053s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e32e99-7cb6-4445-ac8c-e01895385896]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:05 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 Sep 01 01:25:05 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:05 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:05 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:05 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577 Sep 01 01:25:05 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:05 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:05 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.263s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630" returned: 0 in 0.440s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8279dc71-91e2-4fc3-89b0-107271813dfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:25:05 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Deleted volume successfully. Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acfd338-68aa-494c-a8a5-5aa1f4a5f6f8]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-9dc0622d-0eec-499a-a594-26f8186f7ce9 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-f61565e5-d40e-4f54-8016-11b023497ec5-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:05 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577" returned: 0 in 0.446s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:05 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577 Sep 01 01:25:05 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:05 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa Sep 01 01:25:05 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:06 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3b4e22a1-88a7-4918-8f58-0a6614282577" returned: 0 in 0.295s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-quobyte-3b4e22a1-88a7-4918-8f58-0a6614282577" released by "delete_volume" :: held 0.814s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:06 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa" returned: 0 in 0.447s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006 not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:06 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006 Sep 01 01:25:06 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Created reservations ['4c49885d-6606-4aee-ae89-2e6aa23f8858', '40e37fb0-38f1-4c9a-a33c-a56228c89929', '5f88368b-572d-420f-bc35-76f3a181cb09', 'd305c1d7-aefb-4796-8bbd-9381eafe4372'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Flow 'volume_create_manager' (1d519b67-2c71-48b3-a4d2-6cb9331d42f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb781da2-4c89-4611-a070-a2d5d8d6bc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb781da2-4c89-4611-a070-a2d5d8d6bc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1d32e9-e3ef-47e7-b424-ea40fa77b12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a897f322214bfb971bd1bcbb7ee053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:06Z,use_quota=True,user_id='4b9fc52e8bf34bde8821022dd5e03f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b917d24e-4868-41ed-a689-e0a43a29c378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b917d24e-4868-41ed-a689-e0a43a29c378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0a708c-b74d-4913-8fa2-46e9abe89cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0a708c-b74d-4913-8fa2-46e9abe89cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a1d32e9-e3ef-47e7-b424-ea40fa77b12c', 'volume_name': 'volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf70001-4b60-43d8-83ec-d1ac85456de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf70001-4b60-43d8-83ec-d1ac85456de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45f2f09-233a-4c9e-b803-ff04634b02c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:06 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Volume 1a1d32e9-e3ef-47e7-b424-ea40fa77b12c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c', 'volume_size': 1} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-94c8d37e-030d-47db-b325-ca15ce9b9981-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:06 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:06 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-94c8d37e-030d-47db-b325-ca15ce9b9981-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-quobyte-94c8d37e-030d-47db-b325-ca15ce9b9981" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-94c8d37e-030d-47db-b325-ca15ce9b9981" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e50d53-3a5f-493b-a965-92248dd01ab5]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:06 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981 Sep 01 01:25:06 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:06 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.412s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Deleted volume successfully. Sep 01 01:25:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3b72e889-1483-48dd-9126-19e0eb5a3128 tempest-CreateVolumesFromSourceVolumeTest-1150182385 None] Lock "cinder-3b4e22a1-88a7-4918-8f58-0a6614282577-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:07 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981" returned: 0 in 0.739s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:07 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981 Sep 01 01:25:07 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:07 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-94c8d37e-030d-47db-b325-ca15ce9b9981" returned: 0 in 0.628s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-94c8d37e-030d-47db-b325-ca15ce9b9981" released by "delete_volume" :: held 1.469s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:08 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created reservations ['5f179a30-2428-4de7-a138-0ba26f2b8d78', '96b9c9ba-2165-4fbe-b323-0e1ffd59d4e2', 'ce8072a9-4935-4c14-b2c0-14f77a52cb71', 'be7a63c2-569a-4147-8eb1-d28ef53e0191'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:08 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:08 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:09 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.538s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:09 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:09 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Deleted volume successfully. Sep 01 01:25:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1aa2796c-7f4c-4074-9602-f75046c9a4f6 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-94c8d37e-030d-47db-b325-ca15ce9b9981-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-ef06ffd2-de44-45ec-909a-ce6d2703fe57-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-ef06ffd2-de44-45ec-909a-ce6d2703fe57-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-quobyte-ef06ffd2-de44-45ec-909a-ce6d2703fe57" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-ef06ffd2-de44-45ec-909a-ce6d2703fe57" acquired by "delete_volume" :: waited 0.046s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:09 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ddd802-2aa6-4e38-8ade-203f719c5402]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:09 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57 Sep 01 01:25:09 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:10 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57" returned: 0 in 0.700s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:10 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57 Sep 01 01:25:10 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:10 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ef06ffd2-de44-45ec-909a-ce6d2703fe57" returned: 0 in 0.519s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:10 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-ef06ffd2-de44-45ec-909a-ce6d2703fe57" released by "delete_volume" :: held 1.325s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:11 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006" returned: 0 in 4.971s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:11 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:25:11 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Converted 1024.00 MB image at 205.92 MB/s Sep 01 01:25:11 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006 is being set with open permissions: ugo+rw Sep 01 01:25:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:11 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006 Sep 01 01:25:11 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:11 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006" returned: 0 in 0.220s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-f2b4734d-0a73-4952-8be9-187ee3712006" released by "_copy_volume_from_snapshot" :: held 6.181s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:13 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created reservations ['3aa1b11c-88ca-472e-b3b8-d7f0d4a33185', '80e94803-7195-4ec6-a9a4-57353ef860cc', 'e2f2a8d2-3a07-4753-baa5-4558268f4a30', '04c781f8-1e7f-4cc3-9588-2b1a203cd8bd'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-1d9da356-3a41-4974-8ddb-15439edbd630-f2b4734d-0a73-4952-8be9-187ee3712006" released by "_create_volume_from_snapshot" :: held 9.197s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.234s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.941s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1d32e9-e3ef-47e7-b424-ea40fa77b12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a897f322214bfb971bd1bcbb7ee053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:06Z,use_quota=True,user_id='4b9fc52e8bf34bde8821022dd5e03f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Creating volume 1a1d32e9-e3ef-47e7-b424-ea40fa77b12c {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:25:14 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:14 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c 1073741824 Sep 01 01:25:14 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d574f916-9fd0-472f-a6c6-b5112a37c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b4734d-0a73-4952-8be9-187ee3712006', 'volume_size': 1, 'snapshot_id': '1d9da356-3a41-4974-8ddb-15439edbd630'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef2745b-7dd8-4aa0-96ed-86bbc0983b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:14 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c 1073741824" returned: 0 in 0.426s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:15 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Volume volume-f2b4734d-0a73-4952-8be9-187ee3712006 (f2b4734d-0a73-4952-8be9-187ee3712006): created successfully Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef2745b-7dd8-4aa0-96ed-86bbc0983b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Flow 'volume_create_manager' (6277dff7-5707-4fa0-bfef-1c3638323134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:15 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:15 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-11a7f77a-a2bc-4b82-8a0b-0c57c749a7be tempest-VolumeDependencyTests-669000491 None] Created volume successfully. Sep 01 01:25:15 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c Sep 01 01:25:15 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-46b8404f-0782-415f-9bcd-838296095d28-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-46b8404f-0782-415f-9bcd-838296095d28-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Acquiring lock "cinder-1d9da356-3a41-4974-8ddb-15439edbd630-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Lock "cinder-1d9da356-3a41-4974-8ddb-15439edbd630-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Acquiring lock "cinder-quobyte-8279dc71-91e2-4fc3-89b0-107271813dfa" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-quobyte-46b8404f-0782-415f-9bcd-838296095d28" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-8279dc71-91e2-4fc3-89b0-107271813dfa" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Acquiring lock "cinder-quobyte-1d9da356-3a41-4974-8ddb-15439edbd630" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-46b8404f-0782-415f-9bcd-838296095d28" acquired by "delete_volume" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-1d9da356-3a41-4974-8ddb-15439edbd630" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Deleting offline snapshot 1d9da356-3a41-4974-8ddb-15439edbd630 of volume 8279dc71-91e2-4fc3-89b0-107271813dfa {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] snapshot_file for this snap is: volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfde4778-5763-4357-a69f-0f376992a548]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:15 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.503s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eeb94ec-2f4a-4cfe-92d6-7e6f83e61f30]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Deleted volume successfully. Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b08459bb-f717-4993-86e7-fd7c6b0735eb tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-ef06ffd2-de44-45ec-909a-ce6d2703fe57-delete_volume" released by "delete_volume" :: held 6.451s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:15 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c" returned: 0 in 0.529s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:15 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28 Sep 01 01:25:15 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45f2f09-233a-4c9e-b803-ff04634b02c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d7d967-4cdc-495f-bf68-c3dddd141701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:15 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 Sep 01 01:25:15 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:15 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Volume volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c (1a1d32e9-e3ef-47e7-b424-ea40fa77b12c): created successfully Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d7d967-4cdc-495f-bf68-c3dddd141701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:15 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Flow 'volume_create_manager' (1d519b67-2c71-48b3-a4d2-6cb9331d42f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:15 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-602fba22-c2ab-4ca3-979a-166389a7cc44 tempest-CinderUnicodeTest-20955347 None] Created volume successfully. Sep 01 01:25:16 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28" returned: 0 in 0.449s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:16 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28 Sep 01 01:25:16 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:16 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630" returned: 0 in 0.573s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8279dc71-91e2-4fc3-89b0-107271813dfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[606f1052-8400-458a-844e-6c6bb73f869f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:16 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-46b8404f-0782-415f-9bcd-838296095d28" returned: 0 in 0.277s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-46b8404f-0782-415f-9bcd-838296095d28" released by "delete_volume" :: held 0.799s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:16 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa Sep 01 01:25:16 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created reservations ['602d3691-eb56-4cd4-86b6-49c1b2589d4a', 'd6126719-3912-448d-a9da-2b5fc82162b2', '540adc09-77f8-4f15-be9b-4c91c17de37d', 'fffbbbe8-809d-47c9-b6c3-53254ffa4fd8'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:16 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:16 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-8e6794df-ccbd-4566-95b6-554a871f85fd-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-8e6794df-ccbd-4566-95b6-554a871f85fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-quobyte-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-quobyte-8e6794df-ccbd-4566-95b6-554a871f85fd" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-8e6794df-ccbd-4566-95b6-554a871f85fd" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Deleting offline snapshot 8e6794df-ccbd-4566-95b6-554a871f85fd of volume 39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] snapshot_file for this snap is: volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72f58ff-85fb-4305-9015-bed8a6cc3f61]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:16 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.414s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:16 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:17 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Deleted volume successfully. Sep 01 01:25:17 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa" returned: 0 in 0.774s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:17 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd Sep 01 01:25:17 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:17 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-90310b80-f347-41be-b1a8-3fe54552f7f5 tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-46b8404f-0782-415f-9bcd-838296095d28-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:17 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Flow 'volume_create_manager' (16d0541a-7898-45b9-a815-15157b662163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa943412-3d18-413d-8954-b761290e1ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa943412-3d18-413d-8954-b761290e1ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-349498019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9eb491-bbfd-40c7-a302-0219d6cdfad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a897f322214bfb971bd1bcbb7ee053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:17Z,use_quota=True,user_id='4b9fc52e8bf34bde8821022dd5e03f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92617407-8ad0-4a45-9613-99a175a59426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92617407-8ad0-4a45-9613-99a175a59426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1640ed-8d0e-4871-9dc6-cf9658b597f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1640ed-8d0e-4871-9dc6-cf9658b597f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b9eb491-bbfd-40c7-a302-0219d6cdfad3', 'volume_name': 'volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c19de0-4ca4-4f5e-8f82-1f5d8527bbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c19de0-4ca4-4f5e-8f82-1f5d8527bbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbb1d04-f145-4579-93a9-57e99ce02255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:17 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Volume 4b9eb491-bbfd-40c7-a302-0219d6cdfad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3', 'volume_size': 1} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-349498019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9eb491-bbfd-40c7-a302-0219d6cdfad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a897f322214bfb971bd1bcbb7ee053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:17Z,use_quota=True,user_id='4b9fc52e8bf34bde8821022dd5e03f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Creating volume 4b9eb491-bbfd-40c7-a302-0219d6cdfad3 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:25:17 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:17 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd" returned: 0 in 0.589s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:25:17 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 1073741824 Sep 01 01:25:17 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[552bf3e8-42d5-45e6-85b8-1c03ec9ae673]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:17 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630" returned: 0 in 0.485s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:17 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630 Sep 01 01:25:17 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:17 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 Sep 01 01:25:17 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:17 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa.1d9da356-3a41-4974-8ddb-15439edbd630" returned: 0 in 0.316s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-1d9da356-3a41-4974-8ddb-15439edbd630" released by "_delete_snapshot" :: held 2.303s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-8279dc71-91e2-4fc3-89b0-107271813dfa" released by "delete_snapshot" :: held 2.362s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:17 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 1073741824" returned: 0 in 0.545s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:17 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7" returned: 0 in 0.510s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:17 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd Sep 01 01:25:17 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Created reservations ['15e8e9f9-269f-4d55-96c7-742ea631ae18', 'd50f73c7-f081-4b9d-89d8-e6c3862f1074', 'c817f685-bb50-41ab-ba29-4594fb59d3df', 'b6a07849-383f-440d-8a9e-f5584c122ab7'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:18 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 Sep 01 01:25:18 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Delete snapshot completed successfully. Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b6fe6126-be62-4c10-b377-9ca55026c62f tempest-VolumeDependencyTests-669000491 None] Lock "cinder-1d9da356-3a41-4974-8ddb-15439edbd630-delete_snapshot" released by "delete_snapshot" :: held 2.691s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:18 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3" returned: 0 in 0.380s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbb1d04-f145-4579-93a9-57e99ce02255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9400a557-b3d3-4f6f-b818-bd091246f0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:18 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Volume volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 (4b9eb491-bbfd-40c7-a302-0219d6cdfad3): created successfully Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9400a557-b3d3-4f6f-b818-bd091246f0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Flow 'volume_create_manager' (16d0541a-7898-45b9-a815-15157b662163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:18 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd" returned: 0 in 0.499s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-91faee31-085f-4ab0-9a01-be300c7831b3 tempest-CinderUnicodeTest-20955347 None] Created volume successfully. Sep 01 01:25:18 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd Sep 01 01:25:18 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:18 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7.8e6794df-ccbd-4566-95b6-554a871f85fd" returned: 0 in 0.281s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Acquiring lock "cinder-8279dc71-91e2-4fc3-89b0-107271813dfa-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-8e6794df-ccbd-4566-95b6-554a871f85fd" released by "_delete_snapshot" :: held 2.050s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Lock "cinder-8279dc71-91e2-4fc3-89b0-107271813dfa-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7" released by "delete_snapshot" :: held 2.095s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Acquiring lock "cinder-quobyte-8279dc71-91e2-4fc3-89b0-107271813dfa" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-8279dc71-91e2-4fc3-89b0-107271813dfa" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0a21f9-a669-4a72-9ca5-7ac7425ba121]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:18 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created reservations ['08d37b1b-f1f6-4c1e-9354-502171c1c150', 'ac964c5c-cc93-44e0-b0db-e628992bf187', '5cdae226-1b74-4820-b556-6c6247bfff65', '51c72f22-1aa3-4783-bdff-1f5ed66dfa44'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:19 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Delete snapshot completed successfully. Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-682bbebc-04c0-4b0e-b040-9d0dba8c9a9b tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-8e6794df-ccbd-4566-95b6-554a871f85fd-delete_snapshot" released by "delete_snapshot" :: held 2.354s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:19 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa Sep 01 01:25:19 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:19 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa" returned: 0 in 0.429s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:19 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa Sep 01 01:25:19 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:19 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8279dc71-91e2-4fc3-89b0-107271813dfa" returned: 0 in 0.302s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-8279dc71-91e2-4fc3-89b0-107271813dfa" released by "delete_volume" :: held 0.822s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] Creating offline snapshot b0a1e0b4-28d4-426f-9951-3a49da9b64f5 of volume 4b9eb491-bbfd-40c7-a302-0219d6cdfad3 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Created reservations ['81baf41d-0651-4cce-9a4e-2931862c6594', '6bd38f97-9e33-407d-abd1-812909dd7598', '03ec4595-2ade-42ff-8241-a3d5966f556d', 'bc5f3c4d-d0a4-43ac-a9a5-613446120a46'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b4b446-4e7e-4f88-9b50-18ac5e6ccda0]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:19 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:19 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:19 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 Sep 01 01:25:19 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Acquiring lock "cinder-f2b4734d-0a73-4952-8be9-187ee3712006-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "cinder-quobyte-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Lock "cinder-f2b4734d-0a73-4952-8be9-187ee3712006-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7" acquired by "delete_volume" :: waited 0.047s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[da076951-5027-49b8-b936-9a11c218ff39]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Acquiring lock "cinder-quobyte-f2b4734d-0a73-4952-8be9-187ee3712006" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-f2b4734d-0a73-4952-8be9-187ee3712006" acquired by "delete_volume" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:20 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.438s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:20 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Deleted volume successfully. Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e9c2cd-7f82-4315-8c8f-9c5a2d635c93]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:20 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3" returned: 0 in 0.572s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:20 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 Sep 01 01:25:20 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:20 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 1G Sep 01 01:25:20 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-235c7625-5d09-4875-8480-8942cd898bab tempest-VolumeDependencyTests-669000491 None] Lock "cinder-8279dc71-91e2-4fc3-89b0-107271813dfa-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:20 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006 Sep 01 01:25:20 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:20 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7" returned: 0 in 0.464s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:20 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7 Sep 01 01:25:20 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:20 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006" returned: 0 in 0.494s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:20 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006 Sep 01 01:25:20 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:20 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 1G" returned: 0 in 0.556s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:20 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 Sep 01 01:25:20 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:21 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7" returned: 0 in 0.306s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-quobyte-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7" released by "delete_volume" :: held 0.887s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Created reservations ['51eb49f1-bfb8-4496-8040-eba30e9a0f9a', '3213c862-764e-43f2-b5a3-cc2028c4a5bc', 'b327e35d-775e-4a49-aa07-7dc88762fbee', '86097edc-142f-41a9-90af-69905f7de52e'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:21 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f2b4734d-0a73-4952-8be9-187ee3712006" returned: 0 in 0.314s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Lock "cinder-quobyte-f2b4734d-0a73-4952-8be9-187ee3712006" released by "delete_volume" :: held 0.884s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:21 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:21 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:21 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5" returned: 0 in 0.455s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:21 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 is being set with open permissions: ugo+rw Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Created reservations ['73f04eb6-20e1-4c20-9a12-3edf2e443925', 'dcac5ca5-fe4d-4ab8-91a4-ec709b2a2908', '32f87409-9c01-4c29-b859-748de50e7577', '8ea13835-f956-4a83-a391-be033f845c23'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:21 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 Sep 01 01:25:21 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:21 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:21 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:21 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.392s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Deleted volume successfully. Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7dbb2555-f52d-4843-a55e-2954065bd0cd tempest-CreateVolumesFromSnapshotTest-2094696321 None] Lock "cinder-39f3813b-0d58-4065-bb6b-ab8ce8cbfba7-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:21 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5" returned: 0 in 0.366s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:21 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.info Sep 01 01:25:21 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:21 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.420s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Deleted volume successfully. Sep 01 01:25:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-763b1d62-9fc1-406d-b823-a5b98fb3e4f2 tempest-VolumeDependencyTests-669000491 None] Lock "cinder-f2b4734d-0a73-4952-8be9-187ee3712006-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:22 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.info" returned: 0 in 0.337s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:22 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.info is being set with open permissions: ugo+rw Sep 01 01:25:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:22 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.info Sep 01 01:25:22 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:22 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.info" returned: 0 in 0.406s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.829s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:22 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0d8ae7bd-d5ea-4e06-87e5-aa19f6da65f1 tempest-CinderUnicodeTest-20955347 None] Create snapshot completed successfully Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "cinder-b0a1e0b4-28d4-426f-9951-3a49da9b64f5-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-b0a1e0b4-28d4-426f-9951-3a49da9b64f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "cinder-quobyte-4b9eb491-bbfd-40c7-a302-0219d6cdfad3" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-quobyte-4b9eb491-bbfd-40c7-a302-0219d6cdfad3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "cinder-quobyte-b0a1e0b4-28d4-426f-9951-3a49da9b64f5" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-quobyte-b0a1e0b4-28d4-426f-9951-3a49da9b64f5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Deleting offline snapshot b0a1e0b4-28d4-426f-9951-3a49da9b64f5 of volume 4b9eb491-bbfd-40c7-a302-0219d6cdfad3 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] snapshot_file for this snap is: volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c9bc8-b406-48d0-8360-cef02eac1546]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:23 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 Sep 01 01:25:23 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:23 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5" returned: 0 in 0.513s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdacf81-4ae9-4257-a5f9-6309c759401d]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:23 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 Sep 01 01:25:23 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:24 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3" returned: 0 in 0.659s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:24 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 Sep 01 01:25:24 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:25 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5" returned: 0 in 0.654s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:25 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5 Sep 01 01:25:25 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:25 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3.b0a1e0b4-28d4-426f-9951-3a49da9b64f5" returned: 0 in 0.458s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-quobyte-b0a1e0b4-28d4-426f-9951-3a49da9b64f5" released by "_delete_snapshot" :: held 2.474s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-quobyte-4b9eb491-bbfd-40c7-a302-0219d6cdfad3" released by "delete_snapshot" :: held 2.508s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:25 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Created reservations ['aafb63ad-e714-4fc1-9f7e-9626c07adc90', 'bc5860f1-cfe1-429d-8e96-c4a6ae1569bc', 'b0a1c948-e50c-4a63-8377-c6b2ff361c2c', '9623c30d-f31e-4aa0-b776-93485615679b'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:25 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Delete snapshot completed successfully. Sep 01 01:25:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-ca8ffaa1-8bb6-4aec-b616-508db29d3fb1 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-b0a1e0b4-28d4-426f-9951-3a49da9b64f5-delete_snapshot" released by "delete_snapshot" :: held 2.721s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "cinder-4b9eb491-bbfd-40c7-a302-0219d6cdfad3-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-4b9eb491-bbfd-40c7-a302-0219d6cdfad3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "cinder-quobyte-4b9eb491-bbfd-40c7-a302-0219d6cdfad3" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-quobyte-4b9eb491-bbfd-40c7-a302-0219d6cdfad3" acquired by "delete_volume" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:26 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb7cae4-019f-48e3-8785-2c92681d8bb6]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:26 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 Sep 01 01:25:26 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:27 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3" returned: 0 in 0.447s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:27 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3 Sep 01 01:25:27 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:27 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-4b9eb491-bbfd-40c7-a302-0219d6cdfad3" returned: 0 in 0.335s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-quobyte-4b9eb491-bbfd-40c7-a302-0219d6cdfad3" released by "delete_volume" :: held 0.869s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Created reservations ['d6bb23e7-9e56-4b58-8c3f-c3cd57d2b0be', '8ffe0c8a-4bf4-4daf-bc78-947c441c8db0', '728547ce-31c6-45d1-b1a0-ca24cceab47d', '2c55b771-27bc-4c19-8c47-4802037c9ad0'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:27 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:27 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "cinder-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "cinder-quobyte-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-quobyte-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c" acquired by "delete_volume" :: waited 0.029s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[be94b91e-a21e-4d54-8a7f-b0b073e4e68f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:27 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.342s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:27 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Deleted volume successfully. Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-00f7b4e9-e936-4cb2-987c-a65ccf31a589 tempest-ProjectAdminTests-1164097153 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3822937011719, 'free_capacity_gb': 1774.3822937011719, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87064) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 01:25:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275f962b-f042-4d2f-abc7-72f705c80f80 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-4b9eb491-bbfd-40c7-a302-0219d6cdfad3-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:28 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c Sep 01 01:25:28 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:28 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c" returned: 0 in 0.557s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:28 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c Sep 01 01:25:28 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:28 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c" returned: 0 in 0.304s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-quobyte-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c" released by "delete_volume" :: held 0.927s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:28 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Created reservations ['1de276de-c30a-4661-bce2-57493a3af09f', '00404f5e-6a78-400a-8500-9a51ae3e08dc', '1098725d-f943-4bb1-b0ff-75c028b55f96', 'b2584b38-f636-4b56-b52d-b586bab91bac'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:28 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:28 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:28 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:29 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.377s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:29 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:29 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Deleted volume successfully. Sep 01 01:25:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c276df8e-179d-449d-8265-aa580c565d50 tempest-CinderUnicodeTest-20955347 None] Lock "cinder-1a1d32e9-e3ef-47e7-b424-ea40fa77b12c-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:30 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:25:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Flow 'volume_create_manager' (2a42c74b-51b9-4a7e-a85c-b7c252ef31a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26974042-6ead-4122-be31-ff3c8b7d1ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26974042-6ead-4122-be31-ff3c8b7d1ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36da4dbb-96da-491a-9409-c1e2f2923c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd3288fb02848779cc5bc84befe8273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:30Z,use_quota=True,user_id='5b66472fde3241f89de57bfc63dab2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8cc67a-420f-4608-bfb4-55dd815eef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8cc67a-420f-4608-bfb4-55dd815eef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ecaa73-7b1e-4c24-afad-9f953bf56fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:30 devstack cinder-volume[87064]: DEBUG cinder.image.glance [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Creating Keystone auth plugin from conf {{(pid=87064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:25:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ecaa73-7b1e-4c24-afad-9f953bf56fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36da4dbb-96da-491a-9409-c1e2f2923c35', 'volume_name': 'volume-36da4dbb-96da-491a-9409-c1e2f2923c35', 'volume_size': 1, 'image_id': 'd63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9259cca00ab22e1f909b41f3212c41a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6dd3288fb02848779cc5bc84befe8273', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9fce3c51f6e6324dcd468e0ca0e9f0b5b0bd4622b49629d5b15760df0125892fc1fa8f74032129ffbb4bf478e9d326541272a2522db7de8d11ad6f7f1ef08daf', 'id': 'd63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'created_at': datetime.datetime(2026, 8, 31, 23, 25, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 25, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8/file', 'properties': {}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bda50a8-d2e0-407c-9a16-c1798f2e55cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bda50a8-d2e0-407c-9a16-c1798f2e55cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:31 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca69e35-6fb8-4d38-a813-325091125176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:31 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Volume 36da4dbb-96da-491a-9409-c1e2f2923c35: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36da4dbb-96da-491a-9409-c1e2f2923c35', 'volume_size': 1, 'image_id': 'd63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9259cca00ab22e1f909b41f3212c41a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6dd3288fb02848779cc5bc84befe8273', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9fce3c51f6e6324dcd468e0ca0e9f0b5b0bd4622b49629d5b15760df0125892fc1fa8f74032129ffbb4bf478e9d326541272a2522db7de8d11ad6f7f1ef08daf', 'id': 'd63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'created_at': datetime.datetime(2026, 8, 31, 23, 25, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 25, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8/file', 'properties': {}}, 'image_service': } Sep 01 01:25:31 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Trying to clone 36da4dbb-96da-491a-9409-c1e2f2923c35 from image d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'metadata': {}}]). {{(pid=87064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:25:31 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:25:31 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Image download 0.00 MB at 0.00 MB/s Sep 01 01:25:31 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d5252d-56c6-42d7-9b8d-a6b8af7360bd]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:31 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD Sep 01 01:25:31 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:31 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:32 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD Sep 01 01:25:32 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:32 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD" returned: 1 in 0.494s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:25:32 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Temporary image d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8 is fetched for user 5b66472fde3241f89de57bfc63dab2fd. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:25:32 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[124a3411-643b-4095-804a-30c409eea513]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:32 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD Sep 01 01:25:32 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:33 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:33 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD Sep 01 01:25:33 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:33 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD" returned: 1 in 0.439s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36da4dbb-96da-491a-9409-c1e2f2923c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd3288fb02848779cc5bc84befe8273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:30Z,use_quota=True,user_id='5b66472fde3241f89de57bfc63dab2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Creating volume 36da4dbb-96da-491a-9409-c1e2f2923c35 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:25:33 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:25:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:33 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 1073741824 Sep 01 01:25:33 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:34 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 1073741824" returned: 0 in 0.694s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:34 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 Sep 01 01:25:34 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:34 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35" returned: 0 in 0.434s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:25:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:34 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Attempting download of d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'metadata': {}}])) to volume 36da4dbb-96da-491a-9409-c1e2f2923c35. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:25:34 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3146f2-9727-4def-9962-bc52125dd4d1]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_wdobovq4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:34 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_wdobovq4 Sep 01 01:25:34 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:35 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_wdobovq4" returned: 0 in 0.561s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_wdobovq4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:35 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_wdobovq4 Sep 01 01:25:35 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:35 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_wdobovq4" returned: 1 in 0.609s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_wdobovq4' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:25:35 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f5dea8-4693-4bad-822a-f662c90b02e7]: (4, 'raw') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:36 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD Sep 01 01:25:36 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:36 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:36 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD Sep 01 01:25:36 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:37 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD" returned: 1 in 0.623s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:25:37 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8 was raw, converting to qcow2 {{(pid=87064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:25:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:37 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 Sep 01 01:25:37 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:37 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35" returned: 0 in 0.821s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:37 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8_n3orn76kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:25:37 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 01:25:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:37 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 1G Sep 01 01:25:37 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:38 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 1G" returned: 0 in 0.550s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Downloaded image d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'metadata': {}}])) to volume 36da4dbb-96da-491a-9409-c1e2f2923c35 successfully. {{(pid=87064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Temporary image d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8 for user 5b66472fde3241f89de57bfc63dab2fd is deleted. {{(pid=87064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.volume_utils [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Marking volume 36da4dbb-96da-491a-9409-c1e2f2923c35 as bootable. {{(pid=87064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=200,cinder:UPDATE=280,cinder:INSERT=62,cinder:DELETE=23 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Copying metadata from image d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8 to 36da4dbb-96da-491a-9409-c1e2f2923c35. {{(pid=87064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Creating volume glance metadata for volume 36da4dbb-96da-491a-9409-c1e2f2923c35 backed by image d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8 with: {'image_id': 'd63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c9259cca00ab22e1f909b41f3212c41a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=256,cinder:SELECT=185,cinder:INSERT=75,cinder:DELETE=24 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Flow 'volume_create_manager' (f884b7f3-d94d-4df6-b761-a4dd33e34330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdbb709-5d36-4366-9143-5570fb51fae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdbb709-5d36-4366-9143-5570fb51fae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1119353867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52120af-30f7-48b2-a2e1-3f40e521055a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a20c76f5654d24807041436ded9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:38Z,use_quota=True,user_id='fee26e7da73e43fd9d7f5d8dbb3f4925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c8280d-6fb6-4dff-8bca-a4e037b25bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c8280d-6fb6-4dff-8bca-a4e037b25bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50963fb-abe1-4d0b-a689-a642f476354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50963fb-abe1-4d0b-a689-a642f476354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f52120af-30f7-48b2-a2e1-3f40e521055a', 'volume_name': 'volume-f52120af-30f7-48b2-a2e1-3f40e521055a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce3d7b6-93a0-4623-b6f9-65bc95eb7722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce3d7b6-93a0-4623-b6f9-65bc95eb7722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d511249-2027-4c4b-a1c6-8177fb8fa717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:38 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Volume f52120af-30f7-48b2-a2e1-3f40e521055a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f52120af-30f7-48b2-a2e1-3f40e521055a', 'volume_size': 1} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1119353867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52120af-30f7-48b2-a2e1-3f40e521055a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a20c76f5654d24807041436ded9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:38Z,use_quota=True,user_id='fee26e7da73e43fd9d7f5d8dbb3f4925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Creating volume f52120af-30f7-48b2-a2e1-3f40e521055a {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:25:38 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:25:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:38 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a 1073741824 Sep 01 01:25:38 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca69e35-6fb8-4d38-a813-325091125176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36da4dbb-96da-491a-9409-c1e2f2923c35', 'volume_size': 1, 'image_id': 'd63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9259cca00ab22e1f909b41f3212c41a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6dd3288fb02848779cc5bc84befe8273', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9fce3c51f6e6324dcd468e0ca0e9f0b5b0bd4622b49629d5b15760df0125892fc1fa8f74032129ffbb4bf478e9d326541272a2522db7de8d11ad6f7f1ef08daf', 'id': 'd63e9ac6-a3cd-496b-b2d5-19ca6b553ee8', 'created_at': datetime.datetime(2026, 8, 31, 23, 25, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 25, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d63e9ac6-a3cd-496b-b2d5-19ca6b553ee8/file', 'properties': {}}, 'image_service': }' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f822e78-ccbd-426d-a313-2808b1320169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Volume volume-36da4dbb-96da-491a-9409-c1e2f2923c35 (36da4dbb-96da-491a-9409-c1e2f2923c35): created successfully Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f822e78-ccbd-426d-a313-2808b1320169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Flow 'volume_create_manager' (2a42c74b-51b9-4a7e-a85c-b7c252ef31a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:39 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a 1073741824" returned: 0 in 0.507s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:39 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-14e58248-1ba8-4d46-bc16-56020314c367 tempest-VolumeImageDependencyTests-2058717712 None] Created volume successfully. Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:39 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a Sep 01 01:25:39 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:39 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a" returned: 0 in 0.303s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d511249-2027-4c4b-a1c6-8177fb8fa717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f52120af-30f7-48b2-a2e1-3f40e521055a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d0bb87-ea5b-4cec-9f1f-fd8eed941541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Volume volume-f52120af-30f7-48b2-a2e1-3f40e521055a (f52120af-30f7-48b2-a2e1-3f40e521055a): created successfully Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d0bb87-ea5b-4cec-9f1f-fd8eed941541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Flow 'volume_create_manager' (f884b7f3-d94d-4df6-b761-a4dd33e34330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:39 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-770aecfe-5611-4784-a928-722cfea23def tempest-ProjectReaderTests-1756815867 None] Created volume successfully. Sep 01 01:25:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Acquiring lock "cinder-36da4dbb-96da-491a-9409-c1e2f2923c35-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Lock "cinder-36da4dbb-96da-491a-9409-c1e2f2923c35-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Acquiring lock "cinder-quobyte-36da4dbb-96da-491a-9409-c1e2f2923c35" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Lock "cinder-quobyte-36da4dbb-96da-491a-9409-c1e2f2923c35" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:40 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b714a258-0d3f-4d29-8690-954fc9b25a2e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:40 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 Sep 01 01:25:40 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:40 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35" returned: 0 in 0.425s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:40 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35 Sep 01 01:25:40 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:41 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-36da4dbb-96da-491a-9409-c1e2f2923c35" returned: 0 in 0.247s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Lock "cinder-quobyte-36da4dbb-96da-491a-9409-c1e2f2923c35" released by "delete_volume" :: held 0.726s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:41 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Created reservations ['6812f49b-7dac-4e61-99ef-fd06f90759ee', '6a102e92-c48f-4aeb-96ee-f248bf41c794', 'f201aeeb-0f8c-494b-aab2-e2606d285891', '9463ebbe-b7ab-4104-8d45-52916a14174c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:45 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:45 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] Creating offline snapshot a0fbac15-9be4-41b8-89c3-ca93174909e3 of volume f52120af-30f7-48b2-a2e1-3f40e521055a {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccd3a79-9356-4887-9a48-03a670e21764]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:45 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.526s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:45 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Deleted volume successfully. Sep 01 01:25:45 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a Sep 01 01:25:45 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:46 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-959c03dd-33c7-4255-b30d-cd4821544fbb tempest-VolumeImageDependencyTests-2058717712 None] Lock "cinder-36da4dbb-96da-491a-9409-c1e2f2923c35-delete_volume" released by "delete_volume" :: held 5.737s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:46 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a" returned: 0 in 0.597s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:46 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 1G Sep 01 01:25:46 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:47 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 1G" returned: 0 in 0.736s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f52120af-30f7-48b2-a2e1-3f40e521055a -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:47 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f52120af-30f7-48b2-a2e1-3f40e521055a -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 Sep 01 01:25:47 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:47 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f52120af-30f7-48b2-a2e1-3f40e521055a -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3" returned: 0 in 0.431s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:47 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 is being set with open permissions: ugo+rw Sep 01 01:25:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:47 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 Sep 01 01:25:47 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:47 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3" returned: 0 in 0.354s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:47 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.info Sep 01 01:25:47 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:48 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.info" returned: 0 in 0.408s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:48 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.info is being set with open permissions: ugo+rw Sep 01 01:25:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:48 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.info Sep 01 01:25:48 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:48 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.info" returned: 0 in 0.309s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.978s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:48 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8e67222f-e437-4807-9c16-ebc32a83961a tempest-ProjectReaderTests-1756815867 None] Create snapshot completed successfully Sep 01 01:25:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-a0fbac15-9be4-41b8-89c3-ca93174909e3-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Lock "cinder-a0fbac15-9be4-41b8-89c3-ca93174909e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-f52120af-30f7-48b2-a2e1-3f40e521055a" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-f52120af-30f7-48b2-a2e1-3f40e521055a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-a0fbac15-9be4-41b8-89c3-ca93174909e3" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-a0fbac15-9be4-41b8-89c3-ca93174909e3" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Deleting offline snapshot a0fbac15-9be4-41b8-89c3-ca93174909e3 of volume f52120af-30f7-48b2-a2e1-3f40e521055a {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:25:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] snapshot_file for this snap is: volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:25:49 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0d7297-cf39-4225-aa18-53624a2e7e16]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:49 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 Sep 01 01:25:49 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:50 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3" returned: 0 in 0.575s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f52120af-30f7-48b2-a2e1-3f40e521055a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:25:50 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[503f2c66-c4d9-49b6-a89d-faa1af4d23d9]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:50 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a Sep 01 01:25:50 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:50 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a" returned: 0 in 0.466s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:50 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 Sep 01 01:25:50 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:51 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3" returned: 0 in 0.566s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:51 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3 Sep 01 01:25:51 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:51 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a.a0fbac15-9be4-41b8-89c3-ca93174909e3" returned: 0 in 0.328s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-a0fbac15-9be4-41b8-89c3-ca93174909e3" released by "_delete_snapshot" :: held 2.108s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-f52120af-30f7-48b2-a2e1-3f40e521055a" released by "delete_snapshot" :: held 2.151s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:51 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Created reservations ['a53bbc6a-db15-423b-afd2-5adfc49cf99b', '55461899-67b4-4de9-a604-d744100f0b28', 'fbe334b2-f036-40ed-bfba-c8944617565f', 'cf350b90-5dbc-4c5c-a565-51ea11e3cd7d'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:51 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Delete snapshot completed successfully. Sep 01 01:25:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e5dd6825-c4e8-45fd-80ab-fdd0e8fb20ee tempest-ProjectReaderTests-1756815867 None] Lock "cinder-a0fbac15-9be4-41b8-89c3-ca93174909e3-delete_snapshot" released by "delete_snapshot" :: held 2.343s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:25:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:52 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:52 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:53 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.663s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-f52120af-30f7-48b2-a2e1-3f40e521055a-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-f52120af-30f7-48b2-a2e1-3f40e521055a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-f52120af-30f7-48b2-a2e1-3f40e521055a" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-f52120af-30f7-48b2-a2e1-3f40e521055a" acquired by "delete_volume" :: waited 0.068s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (475bdfca-d809-4a65-879c-641d5bb363a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505e4c6a-4ba4-4674-b029-4d366bdbf469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c19de57-9155-43db-8ebc-7da9d23aa52a]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505e4c6a-4ba4-4674-b029-4d366bdbf469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-42490866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:54Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c3686d-95fa-455b-98fa-8c2e7a7ba6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c3686d-95fa-455b-98fa-8c2e7a7ba6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a73a20b-7daf-4e1f-8e33-00e4d63b2881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a73a20b-7daf-4e1f-8e33-00e4d63b2881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7', 'volume_name': 'volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5c64fb-2fea-4247-a7ef-bd43ad3bdca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5c64fb-2fea-4247-a7ef-bd43ad3bdca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f432f9-ec4f-4a3e-ab4a-ea0ddd7fd139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:53 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Volume afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7', 'volume_size': 1} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-42490866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:54Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Creating volume afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:25:54 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:25:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:54 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 1073741824 Sep 01 01:25:54 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:54 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a Sep 01 01:25:54 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:54 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a" returned: 0 in 0.523s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:54 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a Sep 01 01:25:54 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:54 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 1073741824" returned: 0 in 0.699s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:54 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 Sep 01 01:25:54 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:54 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f52120af-30f7-48b2-a2e1-3f40e521055a" returned: 0 in 0.510s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:54 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-f52120af-30f7-48b2-a2e1-3f40e521055a" released by "delete_volume" :: held 1.256s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Created reservations ['7bc55a9a-3a42-4bd3-8a10-b047c0902910', 'c11ee80e-3853-4224-8710-adf3659cb9d0', 'd531facb-835e-45c6-82e1-9d3c091d9b3f', '52a70b08-af24-4a05-a3c4-50c10c3325f6'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:55 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7" returned: 0 in 0.418s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:55 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:25:55 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f432f9-ec4f-4a3e-ab4a-ea0ddd7fd139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c426cac7-0e2e-44c7-804f-707cf6f11ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:55 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Volume volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 (afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7): created successfully Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c426cac7-0e2e-44c7-804f-707cf6f11ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (475bdfca-d809-4a65-879c-641d5bb363a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-39f26cc6-f1d6-4016-bd73-bdadb16e4ec3 tempest-ProjectMemberTests-2018568708 None] Created volume successfully. Sep 01 01:25:55 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.343s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:25:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Deleted volume successfully. Sep 01 01:25:55 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07b3e2b9-4673-40f9-9b7a-1240bd8e84e8 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-f52120af-30f7-48b2-a2e1-3f40e521055a-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] Creating offline snapshot eda42711-b086-478a-8999-ea0b3fb1acc0 of volume afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[428b87bc-f049-4199-9c8d-dd9c28b8282b]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:56 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 Sep 01 01:25:56 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Flow 'volume_create_manager' (fec174ab-3ff1-4ab2-be45-e7c2b867a32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9099ad-92ae-471d-bc46-a43d9e20ef6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9099ad-92ae-471d-bc46-a43d9e20ef6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1393573311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a024e09-7853-425d-ab52-d7f002ce353a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a20c76f5654d24807041436ded9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:56Z,use_quota=True,user_id='fee26e7da73e43fd9d7f5d8dbb3f4925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7501b49-2208-4529-be41-b99ad8e831f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7501b49-2208-4529-be41-b99ad8e831f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac84ce93-12bf-409b-b44f-d015b2f8f6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac84ce93-12bf-409b-b44f-d015b2f8f6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a024e09-7853-425d-ab52-d7f002ce353a', 'volume_name': 'volume-8a024e09-7853-425d-ab52-d7f002ce353a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cf4413-88da-421d-8659-9ca423f307e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cf4413-88da-421d-8659-9ca423f307e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5babb905-6e04-4c7d-a3b4-08435a30ae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:56 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Volume 8a024e09-7853-425d-ab52-d7f002ce353a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a024e09-7853-425d-ab52-d7f002ce353a', 'volume_size': 1} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:56 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7" returned: 0 in 0.382s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:56 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 1G Sep 01 01:25:56 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:57 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 1G" returned: 0 in 0.520s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:57 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 Sep 01 01:25:57 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:57 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0" returned: 0 in 0.369s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:57 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 is being set with open permissions: ugo+rw Sep 01 01:25:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:57 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 Sep 01 01:25:57 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:57 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0" returned: 0 in 0.273s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:57 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.info Sep 01 01:25:57 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:57 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.info" returned: 0 in 0.278s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:57 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.info is being set with open permissions: ugo+rw Sep 01 01:25:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:58 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.info Sep 01 01:25:58 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:58 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.info" returned: 0 in 0.290s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.901s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1393573311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a024e09-7853-425d-ab52-d7f002ce353a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a20c76f5654d24807041436ded9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:56Z,use_quota=True,user_id='fee26e7da73e43fd9d7f5d8dbb3f4925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Creating volume 8a024e09-7853-425d-ab52-d7f002ce353a {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:25:58 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:58 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a 1073741824 Sep 01 01:25:58 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:58 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9bb6b558-09e7-4b83-8647-0b13f2f2a9ae tempest-ProjectMemberTests-2018568708 None] Create snapshot completed successfully Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Flow 'volume_create_manager' (93402435-0318-431c-a254-b98132040790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8037a5dd-c39d-4f23-a462-8340f90a39d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8037a5dd-c39d-4f23-a462-8340f90a39d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1172890973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a8f51c-1876-4d00-9989-cd90dda00780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b13ce1a983a4a0abc255230fd6c7a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:58Z,use_quota=True,user_id='7bc6ed5d37814fe3bad067ad85b00f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ed2c8a-8554-432d-bd8b-60c35b18000a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ed2c8a-8554-432d-bd8b-60c35b18000a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b812a69e-410e-492c-bb6b-79dce07fa334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b812a69e-410e-492c-bb6b-79dce07fa334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a8f51c-1876-4d00-9989-cd90dda00780', 'volume_name': 'volume-64a8f51c-1876-4d00-9989-cd90dda00780', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fee470-b0bf-4261-a985-6c34eb4973b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fee470-b0bf-4261-a985-6c34eb4973b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3859bedc-a645-4946-884a-8baac1d8679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:58 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Volume 64a8f51c-1876-4d00-9989-cd90dda00780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a8f51c-1876-4d00-9989-cd90dda00780', 'volume_size': 1} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:58 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a 1073741824" returned: 0 in 0.464s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:58 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a Sep 01 01:25:58 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:59 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a" returned: 0 in 0.237s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.596s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1172890973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a8f51c-1876-4d00-9989-cd90dda00780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b13ce1a983a4a0abc255230fd6c7a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:25:58Z,use_quota=True,user_id='7bc6ed5d37814fe3bad067ad85b00f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Creating volume 64a8f51c-1876-4d00-9989-cd90dda00780 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:25:59 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5babb905-6e04-4c7d-a3b4-08435a30ae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a024e09-7853-425d-ab52-d7f002ce353a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:59 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 1073741824 Sep 01 01:25:59 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74b733f-f104-441c-8df1-e8683e7dac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:25:59 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Volume volume-8a024e09-7853-425d-ab52-d7f002ce353a (8a024e09-7853-425d-ab52-d7f002ce353a): created successfully Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74b733f-f104-441c-8df1-e8683e7dac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Flow 'volume_create_manager' (fec174ab-3ff1-4ab2-be45-e7c2b867a32e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:25:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d061c8e2-d8f3-4089-9488-1d47132f66fe tempest-ProjectReaderTests-1756815867 None] Created volume successfully. Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-eda42711-b086-478a-8999-ea0b3fb1acc0-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Lock "cinder-eda42711-b086-478a-8999-ea0b3fb1acc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-eda42711-b086-478a-8999-ea0b3fb1acc0" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-eda42711-b086-478a-8999-ea0b3fb1acc0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Deleting offline snapshot eda42711-b086-478a-8999-ea0b3fb1acc0 of volume afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] snapshot_file for this snap is: volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65b81c8-47be-4f38-93ac-ba728672f24c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:59 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 Sep 01 01:25:59 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:59 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 1073741824" returned: 0 in 0.557s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:25:59 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 Sep 01 01:25:59 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:25:59 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0" returned: 0 in 0.500s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bbaaae-e64b-470a-848d-c6585b1c980b]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:25:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:00 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780" returned: 0 in 0.283s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:00 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 Sep 01 01:26:00 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.249s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3859bedc-a645-4946-884a-8baac1d8679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a8f51c-1876-4d00-9989-cd90dda00780', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957b82c2-81ce-451c-8a86-ce34b0b75d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] Creating offline snapshot cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 of volume 8a024e09-7853-425d-ab52-d7f002ce353a {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:26:00 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Volume volume-64a8f51c-1876-4d00-9989-cd90dda00780 (64a8f51c-1876-4d00-9989-cd90dda00780): created successfully Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957b82c2-81ce-451c-8a86-ce34b0b75d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Flow 'volume_create_manager' (93402435-0318-431c-a254-b98132040790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3b1d2a-0d1b-413c-b2b7-3c81ca9fb545]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6fda5933-aaea-4b17-96d3-e60ded500cf9 tempest-SnapshotDependencyTests-1704930853 None] Created volume successfully. Sep 01 01:26:00 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a Sep 01 01:26:00 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:00 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7" returned: 0 in 0.413s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:00 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 Sep 01 01:26:00 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:00 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a" returned: 0 in 0.470s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:00 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 1G Sep 01 01:26:00 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:00 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0" returned: 0 in 0.443s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:00 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0 Sep 01 01:26:00 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:01 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7.eda42711-b086-478a-8999-ea0b3fb1acc0" returned: 0 in 0.270s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:01 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 1G" returned: 0 in 0.483s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a024e09-7853-425d-ab52-d7f002ce353a -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:01 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a024e09-7853-425d-ab52-d7f002ce353a -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 Sep 01 01:26:01 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-eda42711-b086-478a-8999-ea0b3fb1acc0" released by "_delete_snapshot" :: held 1.768s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7" released by "delete_snapshot" :: held 1.801s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Created reservations ['ca880f4e-a569-40fd-ac91-c7f0af206f7a', '1c6c98e6-2b8a-4a15-b807-c6ab528d4fd2', '6ef311cb-0bbf-4d9a-8f7f-315c6be788f9', '39854491-d5a8-42b7-9ea8-7271b2da138e'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:01 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Delete snapshot completed successfully. Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b9b48e05-af03-4bd5-9fd9-bd0ec01ec3cb tempest-ProjectMemberTests-2018568708 None] Lock "cinder-eda42711-b086-478a-8999-ea0b3fb1acc0-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:01 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a024e09-7853-425d-ab52-d7f002ce353a -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899" returned: 0 in 0.341s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:01 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 is being set with open permissions: ugo+rw Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:01 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:01 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Lock "cinder-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ed0e56-6367-4e54-80e6-da6013b1c3f2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:01 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 Sep 01 01:26:01 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:01 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899" returned: 0 in 0.273s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:01 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.info Sep 01 01:26:01 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:01 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7" returned: 0 in 0.358s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:01 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7 Sep 01 01:26:01 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:01 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.info" returned: 0 in 0.252s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:01 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.info is being set with open permissions: ugo+rw Sep 01 01:26:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:01 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.info Sep 01 01:26:01 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:02 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7" returned: 0 in 0.242s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7" released by "delete_volume" :: held 0.657s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:02 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.info" returned: 0 in 0.243s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.468s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] Creating offline snapshot 13bada65-994b-473b-a6c0-5d831f082526 of volume 64a8f51c-1876-4d00-9989-cd90dda00780 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Created reservations ['2ff98138-d8f6-483d-ab98-553fe45df631', '314929a0-79e2-4cd2-aded-3a4a3b2bd358', '1b88f29c-bdc4-4a52-b82f-5500b8f143e7', '2c134ab8-da7f-48a2-a9d6-63754b3dd84a'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2e7912-4ee0-425f-ab2a-ce49eae80fa7]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-385f0288-aedd-4efb-9e0e-0ca4795b59b3 tempest-ProjectReaderTests-1756815867 None] Create snapshot completed successfully Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:02 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 Sep 01 01:26:02 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:02 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:02 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:02 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.287s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Deleted volume successfully. Sep 01 01:26:02 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780" returned: 0 in 0.407s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-aee969e7-7c33-46bc-b17c-bedcc82069ea tempest-ProjectMemberTests-2018568708 None] Lock "cinder-afcaf0e2-e177-4ab0-9c3c-acf2e62f3ca7-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:02 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 1G Sep 01 01:26:02 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-8a024e09-7853-425d-ab52-d7f002ce353a" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-8a024e09-7853-425d-ab52-d7f002ce353a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Deleting offline snapshot cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 of volume 8a024e09-7853-425d-ab52-d7f002ce353a {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] snapshot_file for this snap is: volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f200c41-d22d-4fd7-8840-bdff8dd11827]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (66178d9b-b56c-4ecd-8c46-edc7881487b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894ffd07-16cc-42fd-a6f4-9789d04d1623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894ffd07-16cc-42fd-a6f4-9789d04d1623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-459771566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be54659-531f-478c-bd54-abb9e1aa7113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:03Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a81f07-660f-472f-abc4-2d01bb12bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:03 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a81f07-660f-472f-abc4-2d01bb12bd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b55a5a-3573-4a50-acda-facced65f25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b55a5a-3573-4a50-acda-facced65f25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6be54659-531f-478c-bd54-abb9e1aa7113', 'volume_name': 'volume-6be54659-531f-478c-bd54-abb9e1aa7113', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c097d7b-1310-4148-b5ce-bf9810dc9418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:03 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 Sep 01 01:26:03 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c097d7b-1310-4148-b5ce-bf9810dc9418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46bdf03-e621-4baf-9b9f-74638ee3bdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:03 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Volume 6be54659-531f-478c-bd54-abb9e1aa7113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6be54659-531f-478c-bd54-abb9e1aa7113', 'volume_size': 1} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 1G" returned: 0 in 0.613s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a8f51c-1876-4d00-9989-cd90dda00780 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:03 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a8f51c-1876-4d00-9989-cd90dda00780 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 Sep 01 01:26:03 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:03 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899" returned: 0 in 0.488s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a024e09-7853-425d-ab52-d7f002ce353a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:03 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a8f51c-1876-4d00-9989-cd90dda00780 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526" returned: 0 in 0.327s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:03 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 is being set with open permissions: ugo+rw Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8979016-d18c-469c-92ed-ece1307e5077]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:03 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 Sep 01 01:26:03 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:03 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a Sep 01 01:26:03 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:03 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526" returned: 0 in 0.242s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:03 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.info Sep 01 01:26:03 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:03 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a" returned: 0 in 0.365s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:03 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 Sep 01 01:26:03 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:04 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.info" returned: 0 in 0.258s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:04 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.info is being set with open permissions: ugo+rw Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:04 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.info Sep 01 01:26:04 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:04 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899" returned: 0 in 0.320s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:04 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899 Sep 01 01:26:04 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:04 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.info" returned: 0 in 0.254s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.138s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-459771566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be54659-531f-478c-bd54-abb9e1aa7113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:03Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Creating volume 6be54659-531f-478c-bd54-abb9e1aa7113 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:04 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:04 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 1073741824 Sep 01 01:26:04 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:04 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c93cf8b5-893d-4ea2-8964-a1a1d4a55954 tempest-SnapshotDependencyTests-1704930853 None] Create snapshot completed successfully Sep 01 01:26:04 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a.cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899" returned: 0 in 0.260s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899" released by "_delete_snapshot" :: held 1.544s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-8a024e09-7853-425d-ab52-d7f002ce353a" released by "delete_snapshot" :: held 1.571s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Created reservations ['d204f93b-2201-470e-8322-946ff55b3e6e', '94e6d364-ad83-4a96-b96f-fcf49229319a', '640b67f1-346f-46ef-8fc5-559ec6474071', 'ddb2ee17-a227-43b4-a8cb-5e3bee3bf028'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:04 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Delete snapshot completed successfully. Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-b7ca437a-28be-4b81-b1eb-37f860729935 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-cd7221fd-a6d5-4679-9f0f-a5ea0d3ff899-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:04 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 1073741824" returned: 0 in 0.486s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:04 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 Sep 01 01:26:04 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:05 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113" returned: 0 in 0.304s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46bdf03-e621-4baf-9b9f-74638ee3bdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be54659-531f-478c-bd54-abb9e1aa7113', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084adeee-c83d-4432-8154-b371c11e6b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-8a024e09-7853-425d-ab52-d7f002ce353a-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:05 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Volume volume-6be54659-531f-478c-bd54-abb9e1aa7113 (6be54659-531f-478c-bd54-abb9e1aa7113): created successfully Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084adeee-c83d-4432-8154-b371c11e6b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (66178d9b-b56c-4ecd-8c46-edc7881487b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Lock "cinder-8a024e09-7853-425d-ab52-d7f002ce353a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:05 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-755cc6c9-d877-41de-8f64-f1b040e6846e tempest-ProjectMemberTests-2018568708 None] Created volume successfully. Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-8a024e09-7853-425d-ab52-d7f002ce353a" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-8a024e09-7853-425d-ab52-d7f002ce353a" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60bdd11-5b42-4ad8-90f3-da284f33c9f2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:05 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a Sep 01 01:26:05 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Flow 'volume_create_manager' (b3dd5086-0529-45de-a132-c35861f76465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da7acac-5360-49ee-94f3-73e46b437528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da7acac-5360-49ee-94f3-73e46b437528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ba4bac-d5f1-428e-9c04-4b5eba26b81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b13ce1a983a4a0abc255230fd6c7a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=13bada65-994b-473b-a6c0-5d831f082526,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:06Z,use_quota=True,user_id='7bc6ed5d37814fe3bad067ad85b00f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dc6e95-d1b1-4dd7-bf79-31d8721ab6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dc6e95-d1b1-4dd7-bf79-31d8721ab6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc323a7c-930b-4355-aee9-1c03ccfe2954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc323a7c-930b-4355-aee9-1c03ccfe2954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44ba4bac-d5f1-428e-9c04-4b5eba26b81e', 'volume_name': 'volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e', 'volume_size': 1, 'snapshot_id': '13bada65-994b-473b-a6c0-5d831f082526'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44c2a7c-c52f-411a-a76c-16bc743ef08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44c2a7c-c52f-411a-a76c-16bc743ef08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a7345d-fe53-4202-9524-9c668e10a622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:05 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Volume 44ba4bac-d5f1-428e-9c04-4b5eba26b81e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e', 'volume_size': 1, 'snapshot_id': '13bada65-994b-473b-a6c0-5d831f082526'} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "cinder-quobyte-13bada65-994b-473b-a6c0-5d831f082526-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" by "_create_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-13bada65-994b-473b-a6c0-5d831f082526-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Creating volume 44ba4bac-d5f1-428e-9c04-4b5eba26b81e from snapshot 13bada65-994b-473b-a6c0-5d831f082526 {{(pid=87064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "cinder-quobyte-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" by "_copy_volume_from_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] snapshot: 13bada65-994b-473b-a6c0-5d831f082526, volume: 44ba4bac-d5f1-428e-9c04-4b5eba26b81e, {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:05 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a" returned: 0 in 0.427s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf05db8-3b00-4872-b340-db567006aec1]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:05 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a Sep 01 01:26:05 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:05 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 Sep 01 01:26:05 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:06 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8a024e09-7853-425d-ab52-d7f002ce353a" returned: 0 in 0.264s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-8a024e09-7853-425d-ab52-d7f002ce353a" released by "delete_volume" :: held 0.772s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Created reservations ['c1017b54-6aef-4825-8df9-0d41ec20e51c', '065de1b9-5502-499b-bcfb-95af5d00b315', '629931f5-29f0-4bc4-8ede-15b62c2ebad3', '8c1480bd-515d-4b8e-bfdc-9eeaa8349625'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:06 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526" returned: 0 in 0.459s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a8f51c-1876-4d00-9989-cd90dda00780(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d96e55-9077-405a-b7a7-c1ecb2c464de]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:06 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:06 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:06 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 Sep 01 01:26:06 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:06 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.416s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Deleted volume successfully. Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-1c23b39f-415c-4517-b35c-294166223a0b tempest-ProjectReaderTests-1756815867 None] Lock "cinder-8a024e09-7853-425d-ab52-d7f002ce353a-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:06 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780" returned: 0 in 0.570s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Creating direct copy from snapshot {{(pid=87064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG cinder.utils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Path /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e not found in is_blk_device check {{(pid=87064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:26:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:06 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e Sep 01 01:26:06 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Flow 'volume_create_manager' (ac867f67-4912-420d-8b72-c9177f01eccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d49b95-c485-4eef-a592-e12bfaadd513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d49b95-c485-4eef-a592-e12bfaadd513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-975756232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6c929a-7f67-45f6-83c5-53c49c540041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a20c76f5654d24807041436ded9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:07Z,use_quota=True,user_id='fee26e7da73e43fd9d7f5d8dbb3f4925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e984e9-8f99-4d00-9734-1d73d2259938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e984e9-8f99-4d00-9734-1d73d2259938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662940f4-5d11-4802-a253-db6bb9a168a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662940f4-5d11-4802-a253-db6bb9a168a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6c929a-7f67-45f6-83c5-53c49c540041', 'volume_name': 'volume-0d6c929a-7f67-45f6-83c5-53c49c540041', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986a8ed8-fe5a-41a9-ae8d-91367106d633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986a8ed8-fe5a-41a9-ae8d-91367106d633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c9790a-a668-460f-96ce-8462b7d9f878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:07 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Volume 0d6c929a-7f67-45f6-83c5-53c49c540041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6c929a-7f67-45f6-83c5-53c49c540041', 'volume_size': 1} Sep 01 01:26:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:11 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" returned: 0 in 4.596s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG cinder.image.image_utils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Image conversion details: src /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e {{(pid=87064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:26:11 devstack cinder-volume[87064]: INFO cinder.image.image_utils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Converted 1024.00 MB image at 222.73 MB/s Sep 01 01:26:11 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e is being set with open permissions: ugo+rw Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:11 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e Sep 01 01:26:11 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:11 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" returned: 0 in 0.245s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" released by "_copy_volume_from_snapshot" :: held 5.968s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-13bada65-994b-473b-a6c0-5d831f082526-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" released by "_create_volume_from_snapshot" :: held 6.032s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.058s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.197s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] Creating offline snapshot 1ecf5093-0410-417a-810c-2d117f881cf0 of volume 6be54659-531f-478c-bd54-abb9e1aa7113 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a7345d-fe53-4202-9524-9c668e10a622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e', 'volume_size': 1, 'snapshot_id': '13bada65-994b-473b-a6c0-5d831f082526'}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8170dc-d5a6-4a96-b106-4fb47bfe9168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc05d86-3b27-4d80-af2b-9cf742b708fe]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:11 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Volume volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e (44ba4bac-d5f1-428e-9c04-4b5eba26b81e): created successfully Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8170dc-d5a6-4a96-b106-4fb47bfe9168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:11 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Flow 'volume_create_manager' (b3dd5086-0529-45de-a132-c35861f76465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:11 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0e4e8a5b-bd08-4361-8794-fa8e601ba959 tempest-SnapshotDependencyTests-1704930853 None] Created volume successfully. Sep 01 01:26:11 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 Sep 01 01:26:11 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:12 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113" returned: 0 in 0.376s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:12 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 1G Sep 01 01:26:12 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "cinder-13bada65-994b-473b-a6c0-5d831f082526-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-13bada65-994b-473b-a6c0-5d831f082526-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "cinder-quobyte-64a8f51c-1876-4d00-9989-cd90dda00780" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-64a8f51c-1876-4d00-9989-cd90dda00780" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "cinder-quobyte-13bada65-994b-473b-a6c0-5d831f082526" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-13bada65-994b-473b-a6c0-5d831f082526" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Deleting offline snapshot 13bada65-994b-473b-a6c0-5d831f082526 of volume 64a8f51c-1876-4d00-9989-cd90dda00780 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] snapshot_file for this snap is: volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74d904a-75cf-4229-bdcc-24ab4238536e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:12 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 Sep 01 01:26:12 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:12 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 1G" returned: 0 in 0.491s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6be54659-531f-478c-bd54-abb9e1aa7113 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:12 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6be54659-531f-478c-bd54-abb9e1aa7113 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 Sep 01 01:26:12 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:12 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526" returned: 0 in 0.410s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a8f51c-1876-4d00-9989-cd90dda00780(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[95de3f79-1362-420a-91d5-8024d47ff3a9]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:13 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 Sep 01 01:26:13 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:13 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6be54659-531f-478c-bd54-abb9e1aa7113 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0" returned: 0 in 0.342s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:13 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 is being set with open permissions: ugo+rw Sep 01 01:26:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:13 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 Sep 01 01:26:13 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:13 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0" returned: 0 in 0.289s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:13 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.info Sep 01 01:26:13 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:13 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780" returned: 0 in 0.576s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:13 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 Sep 01 01:26:13 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:13 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.info" returned: 0 in 0.278s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:13 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.info is being set with open permissions: ugo+rw Sep 01 01:26:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:13 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.info Sep 01 01:26:13 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:13 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526" returned: 0 in 0.404s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:13 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526 Sep 01 01:26:13 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:13 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.info" returned: 0 in 0.271s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.170s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.782s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-975756232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6c929a-7f67-45f6-83c5-53c49c540041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a20c76f5654d24807041436ded9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:07Z,use_quota=True,user_id='fee26e7da73e43fd9d7f5d8dbb3f4925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Creating volume 0d6c929a-7f67-45f6-83c5-53c49c540041 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:14 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:14 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 1073741824 Sep 01 01:26:14 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:14 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d34574af-2dd5-4e68-be0b-34ac5941d1a5 tempest-ProjectMemberTests-2018568708 None] Create snapshot completed successfully Sep 01 01:26:14 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780.13bada65-994b-473b-a6c0-5d831f082526" returned: 0 in 0.298s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-13bada65-994b-473b-a6c0-5d831f082526" released by "_delete_snapshot" :: held 1.822s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-64a8f51c-1876-4d00-9989-cd90dda00780" released by "delete_snapshot" :: held 1.846s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Created reservations ['de4957a7-9029-4acd-8d0e-7e4393e2d7a5', 'ec00485e-dc79-49e2-8a77-c97ec41ce0ac', '799599e8-92d5-406e-805b-e305def5f72a', '61e9ef4a-13c9-434d-92d1-6068e84f3ce9'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:14 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Delete snapshot completed successfully. Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6533aea-4109-4fd1-bb63-5bde8ac8e4c2 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-13bada65-994b-473b-a6c0-5d831f082526-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:14 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 1073741824" returned: 0 in 0.518s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "cinder-64a8f51c-1876-4d00-9989-cd90dda00780-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-64a8f51c-1876-4d00-9989-cd90dda00780-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:14 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 Sep 01 01:26:14 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "cinder-quobyte-64a8f51c-1876-4d00-9989-cd90dda00780" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-64a8f51c-1876-4d00-9989-cd90dda00780" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4fe965-c9eb-40d3-b8cd-0359fa434f2c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:14 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 Sep 01 01:26:14 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:14 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041" returned: 0 in 0.288s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c9790a-a668-460f-96ce-8462b7d9f878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6c929a-7f67-45f6-83c5-53c49c540041', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7cf823-e116-405f-a4b0-6344a31768d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:14 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Volume volume-0d6c929a-7f67-45f6-83c5-53c49c540041 (0d6c929a-7f67-45f6-83c5-53c49c540041): created successfully Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7cf823-e116-405f-a4b0-6344a31768d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:14 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Flow 'volume_create_manager' (ac867f67-4912-420d-8b72-c9177f01eccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:14 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b6b0e333-52c5-461a-9b41-62ab02a9fd44 tempest-ProjectReaderTests-1756815867 None] Created volume successfully. Sep 01 01:26:15 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780" returned: 0 in 0.449s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-1ecf5093-0410-417a-810c-2d117f881cf0-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:15 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780 Sep 01 01:26:15 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Lock "cinder-1ecf5093-0410-417a-810c-2d117f881cf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-6be54659-531f-478c-bd54-abb9e1aa7113" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-6be54659-531f-478c-bd54-abb9e1aa7113" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-1ecf5093-0410-417a-810c-2d117f881cf0" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-1ecf5093-0410-417a-810c-2d117f881cf0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Deleting offline snapshot 1ecf5093-0410-417a-810c-2d117f881cf0 of volume 6be54659-531f-478c-bd54-abb9e1aa7113 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] snapshot_file for this snap is: volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1596d881-701f-403a-bafc-6c6447655ef9]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:15 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 Sep 01 01:26:15 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:15 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-64a8f51c-1876-4d00-9989-cd90dda00780" returned: 0 in 0.323s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-64a8f51c-1876-4d00-9989-cd90dda00780" released by "delete_volume" :: held 0.844s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Created reservations ['2a753b9d-c95c-43d4-a368-5efed6254146', '02465fa4-7e26-46bf-a314-5d33b00eb1a1', '53c81062-89a8-41e2-9655-0ef6bc3c5a35', 'd879fb79-6a70-43ac-95ba-a085ad6d6419'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:15 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:15 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:15 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0" returned: 0 in 0.449s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6be54659-531f-478c-bd54-abb9e1aa7113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "cinder-44ba4bac-d5f1-428e-9c04-4b5eba26b81e-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5bcd87-a048-44cb-ae5d-bd5f6ee1db8c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-44ba4bac-d5f1-428e-9c04-4b5eba26b81e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "cinder-quobyte-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" acquired by "delete_volume" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f56c896-8764-42d5-b901-96eed52b6c0e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:16 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 Sep 01 01:26:16 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:16 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.402s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:16 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Deleted volume successfully. Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48d5596b-6b33-4ab2-82b4-4e7429afcd14 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-64a8f51c-1876-4d00-9989-cd90dda00780-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] Creating offline snapshot 7cae0899-9adb-4ab7-9f28-7f15f13284e1 of volume 0d6c929a-7f67-45f6-83c5-53c49c540041 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[051308d3-4741-4610-9102-2e76eef49be5]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:16 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e Sep 01 01:26:16 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:16 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 Sep 01 01:26:16 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:16 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113" returned: 0 in 0.602s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:16 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 Sep 01 01:26:16 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:16 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" returned: 0 in 0.532s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:16 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e Sep 01 01:26:16 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:16 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041" returned: 0 in 0.453s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:16 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 1G Sep 01 01:26:16 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:16 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0" returned: 0 in 0.460s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:16 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" returned: 0 in 0.346s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:16 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0 Sep 01 01:26:16 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-quobyte-44ba4bac-d5f1-428e-9c04-4b5eba26b81e" released by "delete_volume" :: held 0.963s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:16 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Created reservations ['a06fce74-e326-4295-b4a7-ee1899c35ddf', '3714d507-97f4-4957-b3c7-13155145c8f5', '9cffcb49-47b0-4504-8ee2-68b371af1b93', '126f2f75-b949-4f7a-9e2f-e2667a0ab209'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:17 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:17 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:17 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 1G" returned: 0 in 0.527s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c929a-7f67-45f6-83c5-53c49c540041 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:17 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c929a-7f67-45f6-83c5-53c49c540041 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 Sep 01 01:26:17 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:17 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113.1ecf5093-0410-417a-810c-2d117f881cf0" returned: 0 in 0.356s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-1ecf5093-0410-417a-810c-2d117f881cf0" released by "_delete_snapshot" :: held 2.036s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-6be54659-531f-478c-bd54-abb9e1aa7113" released by "delete_snapshot" :: held 2.066s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Created reservations ['6a3657df-e302-4b32-84de-f3e8066651e9', '294296a7-6044-45e9-b343-1275dee296d8', '52b4634b-0dca-44be-bfaa-0a8c2000554e', '33b164d3-a031-4e2b-ba3c-32340645059d'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:17 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Delete snapshot completed successfully. Sep 01 01:26:17 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.395s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-2f39abd6-86f4-4c11-b569-e30189f5bd5c tempest-ProjectMemberTests-2018568708 None] Lock "cinder-1ecf5093-0410-417a-810c-2d117f881cf0-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:17 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Deleted volume successfully. Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-07bdbf8c-48f1-4ed1-b1cb-c4885ebe3ab4 tempest-SnapshotDependencyTests-1704930853 None] Lock "cinder-44ba4bac-d5f1-428e-9c04-4b5eba26b81e-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:17 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c929a-7f67-45f6-83c5-53c49c540041 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1" returned: 0 in 0.400s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:17 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 is being set with open permissions: ugo+rw Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:17 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 Sep 01 01:26:17 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:17 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1" returned: 0 in 0.245s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:17 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:17 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.info Sep 01 01:26:17 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:18 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.info" returned: 0 in 0.271s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:18 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.info is being set with open permissions: ugo+rw Sep 01 01:26:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:18 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.info Sep 01 01:26:18 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:18 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.info" returned: 0 in 0.351s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:18 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e23a4b79-b14c-4af4-b51f-22212dfbb1a5 tempest-ProjectReaderTests-1756815867 None] Create snapshot completed successfully Sep 01 01:26:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-6be54659-531f-478c-bd54-abb9e1aa7113-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-6be54659-531f-478c-bd54-abb9e1aa7113-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-6be54659-531f-478c-bd54-abb9e1aa7113" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:18 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-6be54659-531f-478c-bd54-abb9e1aa7113" acquired by "delete_volume" :: waited 0.034s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:18 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6f53a2-be74-4992-895d-9662b96bc316]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:18 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:18 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 Sep 01 01:26:18 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:19 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113" returned: 0 in 0.408s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:19 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113 Sep 01 01:26:19 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-7cae0899-9adb-4ab7-9f28-7f15f13284e1-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-7cae0899-9adb-4ab7-9f28-7f15f13284e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-0d6c929a-7f67-45f6-83c5-53c49c540041" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-0d6c929a-7f67-45f6-83c5-53c49c540041" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-7cae0899-9adb-4ab7-9f28-7f15f13284e1" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-7cae0899-9adb-4ab7-9f28-7f15f13284e1" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Deleting offline snapshot 7cae0899-9adb-4ab7-9f28-7f15f13284e1 of volume 0d6c929a-7f67-45f6-83c5-53c49c540041 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:26:19 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] snapshot_file for this snap is: volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-6be54659-531f-478c-bd54-abb9e1aa7113" returned: 0 in 0.381s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd7e5f6-6521-451e-b7d1-0a56c01b5c81]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-6be54659-531f-478c-bd54-abb9e1aa7113" released by "delete_volume" :: held 0.880s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Created reservations ['bfb3dcbb-5c37-4159-9def-a4d7015ddb6d', 'f4d5bde3-c35b-47ef-900f-54f65ddb21de', '85adc3c4-900c-4787-ace5-7c8921c76012', 'b9ef9850-7de4-49e2-8255-04b95323d8fa'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:19 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 Sep 01 01:26:19 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:19 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:19 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:19 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:20 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1" returned: 0 in 0.440s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6c929a-7f67-45f6-83c5-53c49c540041(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15f3001-a710-4f99-85c2-3d224e3ec58f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:20 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.330s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:20 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Deleted volume successfully. Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-3468b02c-4f8f-48e1-aa50-38595ff84e30 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-6be54659-531f-478c-bd54-abb9e1aa7113-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:20 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 Sep 01 01:26:20 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (89dab1fe-7e12-446a-b82b-07af8abb815d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7822e413-a88f-4582-bab9-6715c20a6066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7822e413-a88f-4582-bab9-6715c20a6066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-338678908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e246a65c-45e7-4a42-abef-1b31c8f4be66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:20Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c22eb87-a60d-43ee-b779-bc13574e6630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c22eb87-a60d-43ee-b779-bc13574e6630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45860f22-c0fa-455f-b60f-70f71cdf5f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45860f22-c0fa-455f-b60f-70f71cdf5f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e246a65c-45e7-4a42-abef-1b31c8f4be66', 'volume_name': 'volume-e246a65c-45e7-4a42-abef-1b31c8f4be66', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62657e7-5d7d-462c-b2f6-9ea630b07c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62657e7-5d7d-462c-b2f6-9ea630b07c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06463131-710a-434c-9686-ebd6dab88380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:20 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Volume e246a65c-45e7-4a42-abef-1b31c8f4be66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e246a65c-45e7-4a42-abef-1b31c8f4be66', 'volume_size': 1} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-338678908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e246a65c-45e7-4a42-abef-1b31c8f4be66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:20Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Creating volume e246a65c-45e7-4a42-abef-1b31c8f4be66 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:20 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:20 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041" returned: 0 in 0.486s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:20 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 1073741824 Sep 01 01:26:20 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:20 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 Sep 01 01:26:20 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:20 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1" returned: 0 in 0.339s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:20 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1 Sep 01 01:26:20 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:20 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 1073741824" returned: 0 in 0.448s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:21 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 Sep 01 01:26:21 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:21 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041.7cae0899-9adb-4ab7-9f28-7f15f13284e1" returned: 0 in 0.257s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-7cae0899-9adb-4ab7-9f28-7f15f13284e1" released by "_delete_snapshot" :: held 1.654s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-0d6c929a-7f67-45f6-83c5-53c49c540041" released by "delete_snapshot" :: held 1.701s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Created reservations ['57124bb3-dc8c-48ca-945b-3667e6641ffc', '23956213-9cab-4c5c-b3c8-773cd7e62997', '2e833dae-6ed8-4511-b80e-62cd5d92d5db', '6acd9d9b-695f-401e-b68c-4ae5de5629fd'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:21 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66" returned: 0 in 0.274s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06463131-710a-434c-9686-ebd6dab88380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e246a65c-45e7-4a42-abef-1b31c8f4be66', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c1ab69-66fc-4982-afd5-4ad87c627d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:21 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Volume volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 (e246a65c-45e7-4a42-abef-1b31c8f4be66): created successfully Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c1ab69-66fc-4982-afd5-4ad87c627d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (89dab1fe-7e12-446a-b82b-07af8abb815d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-dad12675-5120-433d-b394-a6b87a4b8dce tempest-ProjectMemberTests-2018568708 None] Created volume successfully. Sep 01 01:26:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Delete snapshot completed successfully. Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-48da44c5-cd7f-4ae8-9a79-e01bbb43c9f9 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-7cae0899-9adb-4ab7-9f28-7f15f13284e1-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-0d6c929a-7f67-45f6-83c5-53c49c540041-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-0d6c929a-7f67-45f6-83c5-53c49c540041-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-0d6c929a-7f67-45f6-83c5-53c49c540041" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-0d6c929a-7f67-45f6-83c5-53c49c540041" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0673653-bac2-4586-b399-83f40f391779]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:21 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 Sep 01 01:26:21 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:22 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041" returned: 0 in 0.334s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:22 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041 Sep 01 01:26:22 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:22 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-0d6c929a-7f67-45f6-83c5-53c49c540041" returned: 0 in 0.249s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-0d6c929a-7f67-45f6-83c5-53c49c540041" released by "delete_volume" :: held 0.640s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Created reservations ['d2c4b16e-14c5-49bb-8a56-de033e65f241', 'bf91ab3b-7142-4cce-96fe-704ab47c865b', 'e3a2e8bb-ee68-4e97-93f4-87736afaef8a', '5562f768-ab48-477e-a889-8458fc80df6d'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:22 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:22 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] Creating offline snapshot 42f07274-8c6a-4ae5-8bdb-e69b70ef191a of volume e246a65c-45e7-4a42-abef-1b31c8f4be66 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[be033505-03cb-4b17-8e35-08884cc6b304]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:22 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.349s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:22 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Deleted volume successfully. Sep 01 01:26:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-4828353a-63a6-425d-ba18-6697d4ca1720 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-0d6c929a-7f67-45f6-83c5-53c49c540041-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:22 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 Sep 01 01:26:22 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:23 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66" returned: 0 in 0.451s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:23 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a 1G Sep 01 01:26:23 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Flow 'volume_create_manager' (509a3035-d975-46a6-a91f-70d3ef0633b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0c59d1-0567-4aab-b597-dcaca6901708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0c59d1-0567-4aab-b597-dcaca6901708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616003375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c68cad2-cec2-4608-8015-0ae8639c5e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a20c76f5654d24807041436ded9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:23Z,use_quota=True,user_id='fee26e7da73e43fd9d7f5d8dbb3f4925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedcba93-9345-4f3e-a2e1-9c65b0fcd8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedcba93-9345-4f3e-a2e1-9c65b0fcd8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ddc9d9-25b6-4316-8217-4c3229e9b34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ddc9d9-25b6-4316-8217-4c3229e9b34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c68cad2-cec2-4608-8015-0ae8639c5e4b', 'volume_name': 'volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b51d5c-9fa3-44d8-9086-04cea1849cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b51d5c-9fa3-44d8-9086-04cea1849cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ede6911-f310-4976-af4f-528bf53678be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:23 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Volume 8c68cad2-cec2-4608-8015-0ae8639c5e4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b', 'volume_size': 1} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:23 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a 1G" returned: 0 in 0.585s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:23 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a Sep 01 01:26:23 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:24 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a" returned: 0 in 0.309s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:24 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a is being set with open permissions: ugo+rw Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:24 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a Sep 01 01:26:24 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:24 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a" returned: 0 in 0.249s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:24 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.info Sep 01 01:26:24 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:24 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.info" returned: 0 in 0.263s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:24 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.info is being set with open permissions: ugo+rw Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:24 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.info Sep 01 01:26:24 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:24 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.info" returned: 0 in 0.250s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616003375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c68cad2-cec2-4608-8015-0ae8639c5e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a20c76f5654d24807041436ded9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:23Z,use_quota=True,user_id='fee26e7da73e43fd9d7f5d8dbb3f4925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Creating volume 8c68cad2-cec2-4608-8015-0ae8639c5e4b {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:24 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:26:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:25 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b 1073741824 Sep 01 01:26:25 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:25 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-00fba895-169b-4962-9b34-f08d4746d0e6 tempest-ProjectMemberTests-2018568708 None] Create snapshot completed successfully Sep 01 01:26:25 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b 1073741824" returned: 0 in 0.468s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:25 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b Sep 01 01:26:25 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:25 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b" returned: 0 in 0.245s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ede6911-f310-4976-af4f-528bf53678be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7d3a33-fbf3-491b-8597-1b3f7b7af9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:25 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Volume volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b (8c68cad2-cec2-4608-8015-0ae8639c5e4b): created successfully Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7d3a33-fbf3-491b-8597-1b3f7b7af9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Flow 'volume_create_manager' (509a3035-d975-46a6-a91f-70d3ef0633b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:25 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-70addc48-3da0-4c4a-9576-4dc7051a4d43 tempest-ProjectReaderTests-1756815867 None] Created volume successfully. Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-42f07274-8c6a-4ae5-8bdb-e69b70ef191a-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-42f07274-8c6a-4ae5-8bdb-e69b70ef191a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-e246a65c-45e7-4a42-abef-1b31c8f4be66" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-e246a65c-45e7-4a42-abef-1b31c8f4be66" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-42f07274-8c6a-4ae5-8bdb-e69b70ef191a" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-42f07274-8c6a-4ae5-8bdb-e69b70ef191a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:25 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Deleting offline snapshot 42f07274-8c6a-4ae5-8bdb-e69b70ef191a of volume e246a65c-45e7-4a42-abef-1b31c8f4be66 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] snapshot_file for this snap is: volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ffdf31-1fb2-44ba-b2b8-2e69f03521b4]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:26 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a Sep 01 01:26:26 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:26 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a" returned: 0 in 0.397s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e246a65c-45e7-4a42-abef-1b31c8f4be66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[add8290a-2fc1-48d8-bcad-60e511c9ebd2]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:26 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 Sep 01 01:26:26 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] Creating offline snapshot 43af7d82-7cd2-4061-99c4-68ba64f859d8 of volume 8c68cad2-cec2-4608-8015-0ae8639c5e4b {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeb9384-4fa6-49ad-8666-45a34860b94b]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:26 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b Sep 01 01:26:26 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:26 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66" returned: 0 in 0.364s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:26 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a Sep 01 01:26:26 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:27 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b" returned: 0 in 0.394s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:27 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 1G Sep 01 01:26:27 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:27 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a" returned: 0 in 0.376s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:27 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a Sep 01 01:26:27 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:27 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66.42f07274-8c6a-4ae5-8bdb-e69b70ef191a" returned: 0 in 0.310s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-42f07274-8c6a-4ae5-8bdb-e69b70ef191a" released by "_delete_snapshot" :: held 1.551s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-e246a65c-45e7-4a42-abef-1b31c8f4be66" released by "delete_snapshot" :: held 1.577s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:27 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 1G" returned: 0 in 0.492s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:27 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 Sep 01 01:26:27 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Created reservations ['7696347e-2936-4eab-a8c7-3c7a867ff4f9', 'c638583f-6d80-44e7-ad9f-19e513d75a57', '4e5317f5-01d7-4b94-afd9-2466eba245b0', '4c89f4bc-676a-41d3-aa93-ee20e3dc637b'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:27 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Delete snapshot completed successfully. Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-10f4fda9-1e83-412d-9e78-d8a90c91e756 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-42f07274-8c6a-4ae5-8bdb-e69b70ef191a-delete_snapshot" released by "delete_snapshot" :: held 1.778s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:27 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8" returned: 0 in 0.324s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:27 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 is being set with open permissions: ugo+rw Sep 01 01:26:27 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:27 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 Sep 01 01:26:27 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-e246a65c-45e7-4a42-abef-1b31c8f4be66-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-e246a65c-45e7-4a42-abef-1b31c8f4be66-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:28 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8" returned: 0 in 0.280s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-e246a65c-45e7-4a42-abef-1b31c8f4be66" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-e246a65c-45e7-4a42-abef-1b31c8f4be66" acquired by "delete_volume" :: waited 0.039s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:28 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.info Sep 01 01:26:28 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[36377af2-320c-4a8e-b725-8f4d383aa113]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:28 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 Sep 01 01:26:28 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:28 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.info" returned: 0 in 0.340s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:28 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.info is being set with open permissions: ugo+rw Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:28 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.info Sep 01 01:26:28 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:28 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66" returned: 0 in 0.427s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:28 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66 Sep 01 01:26:28 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:28 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.info" returned: 0 in 0.308s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:28 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:28 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f0d212c9-91aa-40de-b30a-1dc7477390b4 tempest-ProjectReaderTests-1756815867 None] Create snapshot completed successfully Sep 01 01:26:29 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e246a65c-45e7-4a42-abef-1b31c8f4be66" returned: 0 in 0.261s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-e246a65c-45e7-4a42-abef-1b31c8f4be66" released by "delete_volume" :: held 0.787s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Created reservations ['89478159-8f84-452f-9a31-8420c4da953e', 'f5ce94f8-b94e-48ba-bedb-7a57490e6822', 'd9406481-f8fc-4226-8800-0264534b385e', '12237812-e65f-48d0-bbeb-c05b9e716f0e'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:29 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:29 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:29 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.310s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:29 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Deleted volume successfully. Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e4ccf243-fdb6-43cc-85bc-1c358f085cd2 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-e246a65c-45e7-4a42-abef-1b31c8f4be66-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-43af7d82-7cd2-4061-99c4-68ba64f859d8-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-43af7d82-7cd2-4061-99c4-68ba64f859d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-8c68cad2-cec2-4608-8015-0ae8639c5e4b" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-8c68cad2-cec2-4608-8015-0ae8639c5e4b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-43af7d82-7cd2-4061-99c4-68ba64f859d8" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:29 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (642b223c-f7b6-4172-9a81-e004411cccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e6d0da-2b01-4afe-b4f4-ca799b04b3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e6d0da-2b01-4afe-b4f4-ca799b04b3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822969490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73f3c27-a1c4-4b82-b817-88d73802edd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:30Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7aee75d-36cd-405b-baac-354c348df6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7aee75d-36cd-405b-baac-354c348df6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ccb45c-973e-4f8f-bfd9-3216f63f2860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ccb45c-973e-4f8f-bfd9-3216f63f2860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a73f3c27-a1c4-4b82-b817-88d73802edd7', 'volume_name': 'volume-a73f3c27-a1c4-4b82-b817-88d73802edd7', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52003677-c16f-4165-90ee-e2979850823f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52003677-c16f-4165-90ee-e2979850823f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc3b933-3af3-4d03-9afc-09377620c5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Volume a73f3c27-a1c4-4b82-b817-88d73802edd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a73f3c27-a1c4-4b82-b817-88d73802edd7', 'volume_size': 1} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822969490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73f3c27-a1c4-4b82-b817-88d73802edd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:30Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Creating volume a73f3c27-a1c4-4b82-b817-88d73802edd7 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:30 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-43af7d82-7cd2-4061-99c4-68ba64f859d8" acquired by "_delete_snapshot" :: waited 0.111s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Deleting offline snapshot 43af7d82-7cd2-4061-99c4-68ba64f859d8 of volume 8c68cad2-cec2-4608-8015-0ae8639c5e4b {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:26:30 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 1073741824 Sep 01 01:26:30 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] snapshot_file for this snap is: volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0daeabc-a907-4a5a-9c6f-2d461f2cae32]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:30 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 Sep 01 01:26:30 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:30 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 1073741824" returned: 0 in 0.473s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:30 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8" returned: 0 in 0.436s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a26ef1-3753-4140-8ed7-e18026227281]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:30 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 Sep 01 01:26:30 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:30 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b Sep 01 01:26:30 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:30 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7" returned: 0 in 0.261s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc3b933-3af3-4d03-9afc-09377620c5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a73f3c27-a1c4-4b82-b817-88d73802edd7', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e137228-85a5-4e14-ac10-78fc323c18ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:30 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Volume volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 (a73f3c27-a1c4-4b82-b817-88d73802edd7): created successfully Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e137228-85a5-4e14-ac10-78fc323c18ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (642b223c-f7b6-4172-9a81-e004411cccce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:30 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-dbb4861d-87c4-4561-a331-9f435faa5778 tempest-ProjectMemberTests-2018568708 None] Created volume successfully. Sep 01 01:26:30 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b" returned: 0 in 0.394s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:30 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:31 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 Sep 01 01:26:31 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:31 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8" returned: 0 in 0.311s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:31 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8 Sep 01 01:26:31 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:31 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:31 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b.43af7d82-7cd2-4061-99c4-68ba64f859d8" returned: 0 in 0.240s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:31 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-43af7d82-7cd2-4061-99c4-68ba64f859d8" released by "_delete_snapshot" :: held 1.495s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:31 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-8c68cad2-cec2-4608-8015-0ae8639c5e4b" released by "delete_snapshot" :: held 1.612s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:31 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Created reservations ['e04a7122-dc09-4580-98f5-8a14b573c53f', 'c7f80f52-8c91-4427-bcbf-ca3edac18a6f', 'cec298cf-cfb6-4bbe-a797-e9bcb441e949', '40186860-c97d-4426-8fb5-9a23590ffae1'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:31 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Delete snapshot completed successfully. Sep 01 01:26:31 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-203029f5-632f-4424-b382-bbfee8250b57 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-43af7d82-7cd2-4061-99c4-68ba64f859d8-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-8c68cad2-cec2-4608-8015-0ae8639c5e4b-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-8c68cad2-cec2-4608-8015-0ae8639c5e4b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-8c68cad2-cec2-4608-8015-0ae8639c5e4b" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-8c68cad2-cec2-4608-8015-0ae8639c5e4b" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf2298d-4e7f-4459-ae8a-15f6bbd10485]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] Creating offline snapshot 78fab67d-8efa-4e8c-be32-a6ef499e4edf of volume a73f3c27-a1c4-4b82-b817-88d73802edd7 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae395b2d-5dda-4b26-a262-2fb88e4bc9f0]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:32 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b Sep 01 01:26:32 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:32 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 Sep 01 01:26:32 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:32 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b" returned: 0 in 0.394s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:32 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b Sep 01 01:26:32 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:32 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7" returned: 0 in 0.383s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:32 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf 1G Sep 01 01:26:32 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:32 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-8c68cad2-cec2-4608-8015-0ae8639c5e4b" returned: 0 in 0.300s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-8c68cad2-cec2-4608-8015-0ae8639c5e4b" released by "delete_volume" :: held 0.753s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:32 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Created reservations ['9560e309-979e-4c0e-b07b-13484beb470d', '1f060cdf-02ab-455d-9fd5-c8968f23d9ad', '0348fb4e-2237-4156-a49c-5c537c3f11a1', 'fe0053bf-451a-4ce6-95b6-2b321284ce61'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:33 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf 1G" returned: 0 in 0.420s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:33 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:33 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:33 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf Sep 01 01:26:33 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:33 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.270s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:33 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Deleted volume successfully. Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-0fcf8789-c0a0-43fc-8007-7ad08f5bca61 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-8c68cad2-cec2-4608-8015-0ae8639c5e4b-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:33 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf" returned: 0 in 0.337s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:33 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf is being set with open permissions: ugo+rw Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:33 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf Sep 01 01:26:33 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:33 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf" returned: 0 in 0.272s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:33 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.info Sep 01 01:26:33 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Flow 'volume_create_manager' (712e5b35-9107-4193-a559-c34bf1f5ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c16e840-4b76-4f4d-a717-2f3d621655b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c16e840-4b76-4f4d-a717-2f3d621655b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033600081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a20c76f5654d24807041436ded9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:34Z,use_quota=True,user_id='fee26e7da73e43fd9d7f5d8dbb3f4925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb34558-87f6-4818-a441-db436e9521d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb34558-87f6-4818-a441-db436e9521d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508b21e2-a50c-414f-b6b3-a1c935be0951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508b21e2-a50c-414f-b6b3-a1c935be0951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4', 'volume_name': 'volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976b13c3-f4ad-4f12-ae3d-1d0e933804a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976b13c3-f4ad-4f12-ae3d-1d0e933804a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865fcbb6-1042-4b8a-ba8a-ba3a3499ebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:33 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Volume f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4', 'volume_size': 1} Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:33 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.info" returned: 0 in 0.270s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:33 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.info is being set with open permissions: ugo+rw Sep 01 01:26:33 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:34 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.info Sep 01 01:26:34 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:34 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.info" returned: 0 in 0.231s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.359s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033600081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a20c76f5654d24807041436ded9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:34Z,use_quota=True,user_id='fee26e7da73e43fd9d7f5d8dbb3f4925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Creating volume f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:34 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:34 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 1073741824 Sep 01 01:26:34 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-1b94906a-0184-4b79-8919-d42396ec5435 tempest-ProjectMemberTests-2018568708 None] Create snapshot completed successfully Sep 01 01:26:34 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 1073741824" returned: 0 in 0.401s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:34 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 Sep 01 01:26:34 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:34 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4" returned: 0 in 0.227s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865fcbb6-1042-4b8a-ba8a-ba3a3499ebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199aca21-ccba-464b-b47c-7cbf531f43a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:34 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Volume volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 (f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4): created successfully Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199aca21-ccba-464b-b47c-7cbf531f43a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:34 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Flow 'volume_create_manager' (712e5b35-9107-4193-a559-c34bf1f5ef66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:34 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2de729b4-f487-4d6e-b734-43bce4cd20ea tempest-ProjectReaderTests-1756815867 None] Created volume successfully. Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-78fab67d-8efa-4e8c-be32-a6ef499e4edf-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Lock "cinder-78fab67d-8efa-4e8c-be32-a6ef499e4edf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-a73f3c27-a1c4-4b82-b817-88d73802edd7" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-a73f3c27-a1c4-4b82-b817-88d73802edd7" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-78fab67d-8efa-4e8c-be32-a6ef499e4edf" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-78fab67d-8efa-4e8c-be32-a6ef499e4edf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Deleting offline snapshot 78fab67d-8efa-4e8c-be32-a6ef499e4edf of volume a73f3c27-a1c4-4b82-b817-88d73802edd7 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] snapshot_file for this snap is: volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a789e302-957f-47d7-a8af-5a037d5638a0]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:35 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf Sep 01 01:26:35 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:35 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf" returned: 0 in 0.350s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a73f3c27-a1c4-4b82-b817-88d73802edd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceffddde-4d09-4066-a9a1-3626566fd48b]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:35 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:35 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 Sep 01 01:26:35 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] Creating offline snapshot b19fac3b-4757-4658-88fa-f80ddbfcf7d8 of volume f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48dd233-360e-4017-91ea-324de8f74383]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:36 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 Sep 01 01:26:36 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:36 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7" returned: 0 in 0.380s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:36 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf Sep 01 01:26:36 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:36 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4" returned: 0 in 0.364s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:36 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 1G Sep 01 01:26:36 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:36 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf" returned: 0 in 0.339s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:36 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf Sep 01 01:26:36 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:36 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 1G" returned: 0 in 0.398s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:36 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7.78fab67d-8efa-4e8c-be32-a6ef499e4edf" returned: 0 in 0.291s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:36 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 Sep 01 01:26:36 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-78fab67d-8efa-4e8c-be32-a6ef499e4edf" released by "_delete_snapshot" :: held 1.442s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-a73f3c27-a1c4-4b82-b817-88d73802edd7" released by "delete_snapshot" :: held 1.468s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Created reservations ['3e3ac784-ccb2-49a9-ab6b-c836536defa0', 'ea1a9f6b-c212-486f-b713-63eddaecfa8a', '5e2f0372-88da-4d95-af0c-1093c0e7bd8f', '2f5e1480-8e6c-4099-a9d3-097515ebc257'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:36 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Delete snapshot completed successfully. Sep 01 01:26:36 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-8471a4f4-a04f-4614-b570-70a13b11b2fa tempest-ProjectMemberTests-2018568708 None] Lock "cinder-78fab67d-8efa-4e8c-be32-a6ef499e4edf-delete_snapshot" released by "delete_snapshot" :: held 1.606s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:37 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8" returned: 0 in 0.272s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:37 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 is being set with open permissions: ugo+rw Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:37 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 Sep 01 01:26:37 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:37 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8" returned: 0 in 0.232s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:37 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.info Sep 01 01:26:37 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-a73f3c27-a1c4-4b82-b817-88d73802edd7-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-a73f3c27-a1c4-4b82-b817-88d73802edd7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-a73f3c27-a1c4-4b82-b817-88d73802edd7" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:37 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.info" returned: 0 in 0.266s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:37 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.info is being set with open permissions: ugo+rw Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-a73f3c27-a1c4-4b82-b817-88d73802edd7" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:37 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.info Sep 01 01:26:37 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb8fbf8-ac33-4156-bc97-2c5b1121471e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:37 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 Sep 01 01:26:37 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:37 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.info" returned: 0 in 0.244s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:37 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.859s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:37 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-22c3ad94-8460-48e1-aa45-f365b118f126 tempest-ProjectReaderTests-1756815867 None] Create snapshot completed successfully Sep 01 01:26:38 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7" returned: 0 in 0.337s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:38 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7 Sep 01 01:26:38 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-b19fac3b-4757-4658-88fa-f80ddbfcf7d8-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-b19fac3b-4757-4658-88fa-f80ddbfcf7d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-b19fac3b-4757-4658-88fa-f80ddbfcf7d8" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-b19fac3b-4757-4658-88fa-f80ddbfcf7d8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Deleting offline snapshot b19fac3b-4757-4658-88fa-f80ddbfcf7d8 of volume f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] snapshot_file for this snap is: volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a82184-05a9-408b-964e-d1e24a189988]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:38 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a73f3c27-a1c4-4b82-b817-88d73802edd7" returned: 0 in 0.251s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-a73f3c27-a1c4-4b82-b817-88d73802edd7" released by "delete_volume" :: held 0.653s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Created reservations ['01799e67-6388-4388-997a-1c8922a883e6', 'd2810934-4874-4d76-9574-1798adf8110f', '3e337550-add3-4c2d-a102-ff64c07b3d7c', 'df892896-23c0-4e10-a652-1419aadea5a9'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:38 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 Sep 01 01:26:38 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:38 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:38 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:38 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8" returned: 0 in 0.369s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:38 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.238s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:38 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Deleted volume successfully. Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=157,cinder:UPDATE=174,cinder:INSERT=51,cinder:DELETE=21 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c01bbd-4c97-41f0-9627-b8b234f55a60]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:38 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-70383ca2-f9ac-4ab1-b727-005727f75ad0 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-a73f3c27-a1c4-4b82-b817-88d73802edd7-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:38 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 Sep 01 01:26:38 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:39 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4" returned: 0 in 0.382s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:39 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 Sep 01 01:26:39 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:UPDATE=201,cinder:SELECT=149,cinder:DELETE=12,cinder:INSERT=58 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (3b4356dd-d33d-4512-bec4-be1597e6b0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6a0773-cb5b-4c6c-97d8-cfa2402d0ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6a0773-cb5b-4c6c-97d8-cfa2402d0ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531060154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949b45dd-e6fc-44d0-a8b5-27f967b454f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:39Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabad536-d40b-413f-9243-5d40cdbe6b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabad536-d40b-413f-9243-5d40cdbe6b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d587aa4-8ff9-4ab9-ac8b-a22c7912eb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d587aa4-8ff9-4ab9-ac8b-a22c7912eb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949b45dd-e6fc-44d0-a8b5-27f967b454f1', 'volume_name': 'volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2f3200-275e-4040-9cf6-8484e880376f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2f3200-275e-4040-9cf6-8484e880376f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098e6c25-b44e-417f-bec2-f1aec0c46bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Volume 949b45dd-e6fc-44d0-a8b5-27f967b454f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1', 'volume_size': 1} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531060154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949b45dd-e6fc-44d0-a8b5-27f967b454f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:39Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Creating volume 949b45dd-e6fc-44d0-a8b5-27f967b454f1 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:39 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:39 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 1073741824 Sep 01 01:26:39 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:39 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8" returned: 0 in 0.338s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:39 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8 Sep 01 01:26:39 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:39 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4.b19fac3b-4757-4658-88fa-f80ddbfcf7d8" returned: 0 in 0.242s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:39 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 1073741824" returned: 0 in 0.416s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-b19fac3b-4757-4658-88fa-f80ddbfcf7d8" released by "_delete_snapshot" :: held 1.449s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4" released by "delete_snapshot" :: held 1.473s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:39 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 Sep 01 01:26:39 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Created reservations ['12771b25-11d4-4c29-882a-04552910a9b1', '375631bd-0d94-400d-974f-d3fb894a83c5', '54780a53-d1db-4996-aeef-8748027d82b9', '2ad207e3-60ec-485c-bc10-d61c575498ab'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:39 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Delete snapshot completed successfully. Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d20d4244-5fdc-4be9-a473-1c7ae2b2cb95 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-b19fac3b-4757-4658-88fa-f80ddbfcf7d8-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:39 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1" returned: 0 in 0.240s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098e6c25-b44e-417f-bec2-f1aec0c46bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb4fd67-93a1-4c7b-b52a-556b83d1a694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:39 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Volume volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 (949b45dd-e6fc-44d0-a8b5-27f967b454f1): created successfully Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb4fd67-93a1-4c7b-b52a-556b83d1a694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:39 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (3b4356dd-d33d-4512-bec4-be1597e6b0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:39 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c43dfbff-9887-415f-8d87-294718268803 tempest-ProjectMemberTests-2018568708 None] Created volume successfully. Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] Creating offline snapshot c6b2f4ea-a46d-46c3-98c3-769388c15248 of volume 949b45dd-e6fc-44d0-a8b5-27f967b454f1 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baedbcd-14b8-4e13-a88b-e53546298cbb]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "cinder-quobyte-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4" acquired by "delete_volume" :: waited 0.021s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7b2036-ad30-436e-b29c-740a4310c7f7]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:40 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 Sep 01 01:26:40 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:40 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 Sep 01 01:26:40 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:40 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1" returned: 0 in 0.398s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:40 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 1G Sep 01 01:26:40 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:40 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4" returned: 0 in 0.377s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:40 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:40 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4 Sep 01 01:26:40 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:41 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4" returned: 0 in 0.256s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:41 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-quobyte-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4" released by "delete_volume" :: held 0.697s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 1G" returned: 0 in 0.382s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:41 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 Sep 01 01:26:41 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Created reservations ['f981407a-80a6-4542-af3e-5278313d97c1', 'af41dd04-4c7f-4263-b76b-b1e142f9b5aa', '556753de-d9c5-4d2f-bac1-3cf476f0c07f', 'a90d97a5-b673-4f0d-a0c5-d85124e2075a'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:41 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:41 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:41 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248" returned: 0 in 0.295s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:41 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 is being set with open permissions: ugo+rw Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:41 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 Sep 01 01:26:41 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:41 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.262s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:41 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Deleted volume successfully. Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f6c24d02-0402-4e9d-a817-6727c43594d3 tempest-ProjectReaderTests-1756815867 None] Lock "cinder-f12dc240-5ac5-4d6e-ba73-4b03a98c4ab4-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:41 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248" returned: 0 in 0.266s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:41 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.info Sep 01 01:26:41 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:41 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.info" returned: 0 in 0.268s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:41 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.info is being set with open permissions: ugo+rw Sep 01 01:26:41 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:42 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.info Sep 01 01:26:42 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:42 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.info" returned: 0 in 0.250s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:42 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-edd3849e-606a-49d9-a7e1-7eabdb504a8b tempest-ProjectMemberTests-2018568708 None] Create snapshot completed successfully Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-c6b2f4ea-a46d-46c3-98c3-769388c15248-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Lock "cinder-c6b2f4ea-a46d-46c3-98c3-769388c15248-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-949b45dd-e6fc-44d0-a8b5-27f967b454f1" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-949b45dd-e6fc-44d0-a8b5-27f967b454f1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-c6b2f4ea-a46d-46c3-98c3-769388c15248" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-c6b2f4ea-a46d-46c3-98c3-769388c15248" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Deleting offline snapshot c6b2f4ea-a46d-46c3-98c3-769388c15248 of volume 949b45dd-e6fc-44d0-a8b5-27f967b454f1 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] snapshot_file for this snap is: volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4906e9c0-7a33-4468-8215-6ed38092cf72]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:42 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 Sep 01 01:26:42 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:42 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248" returned: 0 in 0.375s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[244ab2ce-d359-45c1-b31e-dfa6fbd30d3f]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:42 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:43 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 Sep 01 01:26:43 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:43 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1" returned: 0 in 0.373s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:43 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 Sep 01 01:26:43 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:43 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248" returned: 0 in 0.369s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:43 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248 Sep 01 01:26:43 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:43 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:43 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1.c6b2f4ea-a46d-46c3-98c3-769388c15248" returned: 0 in 0.247s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-c6b2f4ea-a46d-46c3-98c3-769388c15248" released by "_delete_snapshot" :: held 1.478s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-949b45dd-e6fc-44d0-a8b5-27f967b454f1" released by "delete_snapshot" :: held 1.502s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:44 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Created reservations ['655de4b1-508b-4068-840a-87bd81e06d2b', '1d59b674-45be-440d-84cd-b9dd6558e966', '07732d28-7086-44f6-b82b-7533a8b888bd', 'bb165846-f9fa-4ed1-98d1-e789aad493f5'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:44 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Delete snapshot completed successfully. Sep 01 01:26:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-115a5bfc-513d-4cef-9437-2b71b4d3dc3f tempest-ProjectMemberTests-2018568708 None] Lock "cinder-c6b2f4ea-a46d-46c3-98c3-769388c15248-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-949b45dd-e6fc-44d0-a8b5-27f967b454f1-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-949b45dd-e6fc-44d0-a8b5-27f967b454f1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-949b45dd-e6fc-44d0-a8b5-27f967b454f1" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:44 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-949b45dd-e6fc-44d0-a8b5-27f967b454f1" acquired by "delete_volume" :: waited 0.016s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:44 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f833b9d-68d8-4a70-b595-61a0364735f0]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:44 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:44 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 Sep 01 01:26:44 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:45 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1" returned: 0 in 0.395s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:45 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1 Sep 01 01:26:45 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:45 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-949b45dd-e6fc-44d0-a8b5-27f967b454f1" returned: 0 in 0.261s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-949b45dd-e6fc-44d0-a8b5-27f967b454f1" released by "delete_volume" :: held 0.730s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Created reservations ['fa4abba9-4524-4963-96e1-928a68bef806', 'e09b195b-869f-4370-867b-ae75499c4d38', '27171645-570f-434c-bb14-8edd1be0b7e3', '87363337-8f9d-41e0-85c8-cfc41898cff9'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:45 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:45 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:45 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.232s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:45 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Deleted volume successfully. Sep 01 01:26:45 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-d98dc3e4-baeb-43b9-8f16-7ed9fd490058 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-949b45dd-e6fc-44d0-a8b5-27f967b454f1-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (cbd493f5-5e01-40f3-b738-958e1553aa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f3a508-15e8-492a-83d3-8e0a7a92916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f3a508-15e8-492a-83d3-8e0a7a92916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454201545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea260ece-645b-4579-a1bb-237174433290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:46Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e075cd02-c1cd-4b35-8871-c19d355f0a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e075cd02-c1cd-4b35-8871-c19d355f0a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e08ceb2-f4b8-4b6d-8707-3afbd08d4b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e08ceb2-f4b8-4b6d-8707-3afbd08d4b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea260ece-645b-4579-a1bb-237174433290', 'volume_name': 'volume-ea260ece-645b-4579-a1bb-237174433290', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5325ffbd-a9ed-466a-a858-883a30e01c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5325ffbd-a9ed-466a-a858-883a30e01c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226a9b23-b6e0-4618-8972-1c817c23f977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:46 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Volume ea260ece-645b-4579-a1bb-237174433290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea260ece-645b-4579-a1bb-237174433290', 'volume_size': 1} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454201545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea260ece-645b-4579-a1bb-237174433290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:46Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Creating volume ea260ece-645b-4579-a1bb-237174433290 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:46 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:46 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 1073741824 Sep 01 01:26:46 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:46 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 1073741824" returned: 0 in 0.447s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:46 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:46 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 Sep 01 01:26:46 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:47 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290" returned: 0 in 0.246s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226a9b23-b6e0-4618-8972-1c817c23f977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea260ece-645b-4579-a1bb-237174433290', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd670b21-6ffe-4d42-aa8e-80d2039e6d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:47 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Volume volume-ea260ece-645b-4579-a1bb-237174433290 (ea260ece-645b-4579-a1bb-237174433290): created successfully Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd670b21-6ffe-4d42-aa8e-80d2039e6d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (cbd493f5-5e01-40f3-b738-958e1553aa9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:47 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-4e6a57c6-fc70-4aa9-a6fa-7174914681ed tempest-ProjectMemberTests-2018568708 None] Created volume successfully. Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] Creating offline snapshot df8da5e1-0a37-4745-901d-2c63554abb31 of volume ea260ece-645b-4579-a1bb-237174433290 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffc47ec-1781-4685-874b-50bbd0b4fa55]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:47 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 Sep 01 01:26:47 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:47 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290" returned: 0 in 0.345s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:47 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:47 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 1G Sep 01 01:26:47 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:48 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 1G" returned: 0 in 0.369s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea260ece-645b-4579-a1bb-237174433290 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:48 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea260ece-645b-4579-a1bb-237174433290 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 Sep 01 01:26:48 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:48 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea260ece-645b-4579-a1bb-237174433290 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31" returned: 0 in 0.291s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:48 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 is being set with open permissions: ugo+rw Sep 01 01:26:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:48 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 Sep 01 01:26:48 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:48 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31" returned: 0 in 0.267s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:48 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:48 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.info Sep 01 01:26:48 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:49 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.info" returned: 0 in 0.250s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:49 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.info is being set with open permissions: ugo+rw Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:49 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.info Sep 01 01:26:49 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:49 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.info" returned: 0 in 0.266s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:49 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a24e00ef-4839-4d3d-b292-1ca635e9e2d9 tempest-ProjectMemberTests-2018568708 None] Create snapshot completed successfully Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-df8da5e1-0a37-4745-901d-2c63554abb31-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Lock "cinder-df8da5e1-0a37-4745-901d-2c63554abb31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-ea260ece-645b-4579-a1bb-237174433290" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-ea260ece-645b-4579-a1bb-237174433290" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-df8da5e1-0a37-4745-901d-2c63554abb31" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-df8da5e1-0a37-4745-901d-2c63554abb31" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Deleting offline snapshot df8da5e1-0a37-4745-901d-2c63554abb31 of volume ea260ece-645b-4579-a1bb-237174433290 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] snapshot_file for this snap is: volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d640b3cc-af8c-4a53-8317-3f78b063a3b4]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:49 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 Sep 01 01:26:49 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:49 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:49 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31" returned: 0 in 0.339s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:50 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea260ece-645b-4579-a1bb-237174433290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:50 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff638db2-d23b-4ad8-8b88-f92d743c12f4]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:50 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 Sep 01 01:26:50 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:50 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290" returned: 0 in 0.372s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:50 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 Sep 01 01:26:50 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:50 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31" returned: 0 in 0.461s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:50 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:50 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31 Sep 01 01:26:50 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:51 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290.df8da5e1-0a37-4745-901d-2c63554abb31" returned: 0 in 0.276s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-df8da5e1-0a37-4745-901d-2c63554abb31" released by "_delete_snapshot" :: held 1.543s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-ea260ece-645b-4579-a1bb-237174433290" released by "delete_snapshot" :: held 1.569s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:51 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Created reservations ['aafc5ed6-ecd6-4523-91df-8f83da76ca51', '3c9f43f2-81fe-4e75-8e65-a4d53b3aee45', '0253c896-653e-45e5-8f2c-845532f45763', 'd4ad619c-252d-4a31-8974-f05eca885b46'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:51 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Delete snapshot completed successfully. Sep 01 01:26:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7a4d9a41-9b51-4959-a876-dc94d3e3143b tempest-ProjectMemberTests-2018568708 None] Lock "cinder-df8da5e1-0a37-4745-901d-2c63554abb31-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-ea260ece-645b-4579-a1bb-237174433290-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-ea260ece-645b-4579-a1bb-237174433290-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-ea260ece-645b-4579-a1bb-237174433290" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:51 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-ea260ece-645b-4579-a1bb-237174433290" acquired by "delete_volume" :: waited 0.022s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:51 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b62814f-6391-4134-aee4-4a375190dff1]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:51 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:52 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 Sep 01 01:26:52 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:52 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290" returned: 0 in 0.401s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:52 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290 Sep 01 01:26:52 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:52 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-ea260ece-645b-4579-a1bb-237174433290" returned: 0 in 0.297s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-ea260ece-645b-4579-a1bb-237174433290" released by "delete_volume" :: held 0.768s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Created reservations ['b8ef41d0-60f7-4382-9bde-ca56bce1ce71', 'd800c620-4636-4bd4-8458-fe4e687a6ce9', 'a28914ce-67ca-4420-84af-e28d32bf96cc', '547f6a60-0e34-4530-a543-9f761137c128'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:52 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:52 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:52 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:52 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:53 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.305s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:26:53 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.271s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:53 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Deleted volume successfully. Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-c72d211f-369b-4b42-b060-73d1dfbba5d9 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-ea260ece-645b-4579-a1bb-237174433290-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (c0865ea3-dbe9-4f34-9b99-a47a919f4798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db1c9f9-dfe6-44af-9a6b-ba0b10a626d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db1c9f9-dfe6-44af-9a6b-ba0b10a626d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1008030881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1796a72d-eaf1-4549-b0be-9c46bea53bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:53Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4e2570-5fb9-4de5-b1ec-690ef607d72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4e2570-5fb9-4de5-b1ec-690ef607d72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01067537-a14e-499c-9a10-80152767f6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01067537-a14e-499c-9a10-80152767f6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1796a72d-eaf1-4549-b0be-9c46bea53bd0', 'volume_name': 'volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0cd555-260f-4988-8833-2a3d2468efe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0cd555-260f-4988-8833-2a3d2468efe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35af92c2-9691-400e-9d26-959124f8ca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:53 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Volume 1796a72d-eaf1-4549-b0be-9c46bea53bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0', 'volume_size': 1} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1008030881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1796a72d-eaf1-4549-b0be-9c46bea53bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:53Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Creating volume 1796a72d-eaf1-4549-b0be-9c46bea53bd0 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:53 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:26:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:53 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 1073741824 Sep 01 01:26:53 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:54 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 1073741824" returned: 0 in 0.425s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:54 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 Sep 01 01:26:54 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:54 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0" returned: 0 in 0.253s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35af92c2-9691-400e-9d26-959124f8ca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29287051-dd51-4e60-80cb-7c1bf1412c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:54 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Volume volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 (1796a72d-eaf1-4549-b0be-9c46bea53bd0): created successfully Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29287051-dd51-4e60-80cb-7c1bf1412c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (c0865ea3-dbe9-4f34-9b99-a47a919f4798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:54 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-86e93dc9-902d-4cb7-b370-fc52f1d4a17a tempest-ProjectMemberTests-2018568708 None] Created volume successfully. Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Flow 'volume_create_manager' (1f57866f-9f22-4561-afcb-3f50ea8d775c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1368e724-55ae-476b-8313-71ec822a5303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1368e724-55ae-476b-8313-71ec822a5303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997857082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe87770-51f6-4b46-b386-9896aa43211e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951d8710de6047ffb6ba1ebfbf62ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:55Z,use_quota=True,user_id='a1e9ae2104c44f679f509d3bddedc424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3fe709-1ab4-4ffc-98e0-fdb55c648ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3fe709-1ab4-4ffc-98e0-fdb55c648ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a40baa-df47-4d71-a1f3-9677d08f390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a40baa-df47-4d71-a1f3-9677d08f390a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe87770-51f6-4b46-b386-9896aa43211e', 'volume_name': 'volume-dfe87770-51f6-4b46-b386-9896aa43211e', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fe0d57-650a-4472-8ef2-32366c04d519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fe0d57-650a-4472-8ef2-32366c04d519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110245c5-d08d-40e4-a412-4c2066b33ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:54 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Volume dfe87770-51f6-4b46-b386-9896aa43211e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe87770-51f6-4b46-b386-9896aa43211e', 'volume_size': 1} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997857082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe87770-51f6-4b46-b386-9896aa43211e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951d8710de6047ffb6ba1ebfbf62ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:55Z,use_quota=True,user_id='a1e9ae2104c44f679f509d3bddedc424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Creating volume dfe87770-51f6-4b46-b386-9896aa43211e {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:54 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:54 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:54 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e 1073741824 Sep 01 01:26:54 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:55 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e 1073741824" returned: 0 in 0.397s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:55 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e Sep 01 01:26:55 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:55 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e" returned: 0 in 0.239s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.702s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110245c5-d08d-40e4-a412-4c2066b33ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe87770-51f6-4b46-b386-9896aa43211e', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637a7ee0-1c4e-41e9-8e8e-e8e700f7551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] Creating offline snapshot ffbaa946-cf68-412f-8dc6-7721bee8f9df of volume 1796a72d-eaf1-4549-b0be-9c46bea53bd0 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:26:55 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Volume volume-dfe87770-51f6-4b46-b386-9896aa43211e (dfe87770-51f6-4b46-b386-9896aa43211e): created successfully Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637a7ee0-1c4e-41e9-8e8e-e8e700f7551a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Flow 'volume_create_manager' (1f57866f-9f22-4561-afcb-3f50ea8d775c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29d66ef-c8ab-4b80-8393-fe1586b86c4b]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:55 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5c70b80e-aea2-45aa-85ce-a0098d082cf3 tempest-ProjectReaderTests-962163239 None] Created volume successfully. Sep 01 01:26:55 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 Sep 01 01:26:55 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:55 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0" returned: 0 in 0.361s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:55 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:55 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df 1G Sep 01 01:26:55 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:56 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df 1G" returned: 0 in 0.367s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:56 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df Sep 01 01:26:56 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:56 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df" returned: 0 in 0.273s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:56 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df is being set with open permissions: ugo+rw Sep 01 01:26:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:56 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df Sep 01 01:26:56 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:56 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df" returned: 0 in 0.245s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:56 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:56 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.info Sep 01 01:26:56 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Acquiring lock "cinder-dfe87770-51f6-4b46-b386-9896aa43211e-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:56 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Lock "cinder-dfe87770-51f6-4b46-b386-9896aa43211e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Acquiring lock "cinder-quobyte-dfe87770-51f6-4b46-b386-9896aa43211e" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Lock "cinder-quobyte-dfe87770-51f6-4b46-b386-9896aa43211e" acquired by "delete_volume" :: waited 0.013s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76101b6-16e3-449c-84d5-43720c272444]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:57 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.info" returned: 0 in 0.251s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:57 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.info is being set with open permissions: ugo+rw Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:57 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e Sep 01 01:26:57 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:57 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.info Sep 01 01:26:57 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:57 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.info" returned: 0 in 0.234s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:57 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e" returned: 0 in 0.359s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:57 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e Sep 01 01:26:57 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:57 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-b87f3f05-819d-432e-8e92-f5dc409eb501 tempest-ProjectMemberTests-2018568708 None] Create snapshot completed successfully Sep 01 01:26:57 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dfe87770-51f6-4b46-b386-9896aa43211e" returned: 0 in 0.256s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Lock "cinder-quobyte-dfe87770-51f6-4b46-b386-9896aa43211e" released by "delete_volume" :: held 0.652s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Created reservations ['15c2594b-6f41-4099-8932-8a1b20041b13', '0b7b39b6-a0f6-4972-8bb0-01394e2f5695', 'fdde6afe-6138-47a8-8070-240e08c93b75', '82169217-93c7-48ad-aaa2-e70735ddb077'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:57 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:26:57 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-ffbaa946-cf68-412f-8dc6-7721bee8f9df-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-ffbaa946-cf68-412f-8dc6-7721bee8f9df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-1796a72d-eaf1-4549-b0be-9c46bea53bd0" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-1796a72d-eaf1-4549-b0be-9c46bea53bd0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-ffbaa946-cf68-412f-8dc6-7721bee8f9df" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-ffbaa946-cf68-412f-8dc6-7721bee8f9df" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Deleting offline snapshot ffbaa946-cf68-412f-8dc6-7721bee8f9df of volume 1796a72d-eaf1-4549-b0be-9c46bea53bd0 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] snapshot_file for this snap is: volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9635e2-63ec-4ea7-ac74-2ae91f59e31e]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:57 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:58 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df Sep 01 01:26:58 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:58 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.274s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:26:58 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Deleted volume successfully. Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-5c5b5622-0f96-4f93-b43a-1368fca87025 tempest-ProjectReaderTests-962163239 None] Lock "cinder-dfe87770-51f6-4b46-b386-9896aa43211e-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:58 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df" returned: 0 in 0.385s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c205dc2a-3c4c-448d-9567-60fc3e9182eb]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:58 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 Sep 01 01:26:58 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Flow 'volume_create_manager' (0003bfed-f48f-467e-a8f7-1663c59e0695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cc57a3-9817-453b-b362-96eb5b985f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cc57a3-9817-453b-b362-96eb5b985f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121281599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e58dde8-0b17-4054-87d0-d5a0a48262c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951d8710de6047ffb6ba1ebfbf62ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:59Z,use_quota=True,user_id='a1e9ae2104c44f679f509d3bddedc424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92193404-2834-4377-9ce4-7257d0c9931c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92193404-2834-4377-9ce4-7257d0c9931c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eaf3135-a63f-4d99-9d01-2c065c3aa082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eaf3135-a63f-4d99-9d01-2c065c3aa082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e58dde8-0b17-4054-87d0-d5a0a48262c4', 'volume_name': 'volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72af41cf-e5cd-41dd-ad93-dc2f3b7b8d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72af41cf-e5cd-41dd-ad93-dc2f3b7b8d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678c24a3-b9df-46cf-a93c-559d1225a585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:58 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Volume 3e58dde8-0b17-4054-87d0-d5a0a48262c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4', 'volume_size': 1} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121281599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e58dde8-0b17-4054-87d0-d5a0a48262c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951d8710de6047ffb6ba1ebfbf62ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:26:59Z,use_quota=True,user_id='a1e9ae2104c44f679f509d3bddedc424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Creating volume 3e58dde8-0b17-4054-87d0-d5a0a48262c4 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:26:58 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:58 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4 1073741824 Sep 01 01:26:58 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:58 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0" returned: 0 in 0.381s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:58 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df Sep 01 01:26:58 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:59 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df" returned: 0 in 0.333s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:59 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4 1073741824" returned: 0 in 0.432s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:59 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df Sep 01 01:26:59 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:59 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4 Sep 01 01:26:59 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:59 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0.ffbaa946-cf68-412f-8dc6-7721bee8f9df" returned: 0 in 0.268s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-ffbaa946-cf68-412f-8dc6-7721bee8f9df" released by "_delete_snapshot" :: held 1.468s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:59 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-1796a72d-eaf1-4549-b0be-9c46bea53bd0" released by "delete_snapshot" :: held 1.493s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4" returned: 0 in 0.251s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678c24a3-b9df-46cf-a93c-559d1225a585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6858bf08-8e70-403b-9385-0be9b668f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:26:59 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Volume volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4 (3e58dde8-0b17-4054-87d0-d5a0a48262c4): created successfully Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6858bf08-8e70-403b-9385-0be9b668f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Flow 'volume_create_manager' (0003bfed-f48f-467e-a8f7-1663c59e0695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:26:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f63e0a0f-429a-47f7-978e-dda0ded3f573 tempest-ProjectReaderTests-962163239 None] Created volume successfully. Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Created reservations ['c1a544e2-af7f-435c-98b2-1e3fcd56a8d8', '6b96b23b-2b0b-483d-9ff3-79c8662429b2', 'd55ea89a-c2b6-4f43-a2ee-6db5dd9aca93', '1a7bd9f4-266d-4003-aaea-ae2ef0c68eaf'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:26:59 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Delete snapshot completed successfully. Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-73dfed53-228d-4740-b03e-60329d8f6043 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-ffbaa946-cf68-412f-8dc6-7721bee8f9df-delete_snapshot" released by "delete_snapshot" :: held 1.665s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Acquiring lock "cinder-3e58dde8-0b17-4054-87d0-d5a0a48262c4-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Lock "cinder-3e58dde8-0b17-4054-87d0-d5a0a48262c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Acquiring lock "cinder-quobyte-3e58dde8-0b17-4054-87d0-d5a0a48262c4" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Lock "cinder-quobyte-3e58dde8-0b17-4054-87d0-d5a0a48262c4" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2dc9d2-1cb4-49f4-8a8a-e6f2ec551022]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:26:59 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4 Sep 01 01:26:59 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:26:59 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-1796a72d-eaf1-4549-b0be-9c46bea53bd0-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-1796a72d-eaf1-4549-b0be-9c46bea53bd0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-1796a72d-eaf1-4549-b0be-9c46bea53bd0" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-1796a72d-eaf1-4549-b0be-9c46bea53bd0" acquired by "delete_volume" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:00 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4" returned: 0 in 0.390s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b786a3-a19a-4f54-9aa1-8170fa604d9d]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:00 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4 Sep 01 01:27:00 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:00 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 Sep 01 01:27:00 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:00 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-3e58dde8-0b17-4054-87d0-d5a0a48262c4" returned: 0 in 0.244s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Lock "cinder-quobyte-3e58dde8-0b17-4054-87d0-d5a0a48262c4" released by "delete_volume" :: held 0.674s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Created reservations ['4d7d40cb-359b-444c-93c0-96b9263863e1', '2dd3273c-5b50-419d-996c-269c1947530c', 'f54504ee-a2f8-4fb2-9e5f-75f294027c7c', 'c03e3ad3-830a-43a6-a8fb-b29864c12a87'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:00 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0" returned: 0 in 0.367s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:00 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:27:00 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:00 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0 Sep 01 01:27:00 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:00 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.248s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:27:00 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-1796a72d-eaf1-4549-b0be-9c46bea53bd0" returned: 0 in 0.246s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Deleted volume successfully. Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-1796a72d-eaf1-4549-b0be-9c46bea53bd0" released by "delete_volume" :: held 0.691s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-df1476ef-3238-4ed7-9dfa-833ce78fdcd4 tempest-ProjectReaderTests-962163239 None] Lock "cinder-3e58dde8-0b17-4054-87d0-d5a0a48262c4-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Created reservations ['79e0deeb-3c4e-472d-b33d-ac8cc22082f0', '2940260a-a8e8-4e4d-b765-24fa3b24a660', '220e1ba9-41b4-4f2b-a4f8-18109d1a869b', 'cf08c9be-37f8-4e89-9c83-1e879a69c180'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:00 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:00 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:27:00 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:01 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.258s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:27:01 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Deleted volume successfully. Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f8afffb9-aa1f-40bc-b3a3-671fca412fe3 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-1796a72d-eaf1-4549-b0be-9c46bea53bd0-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Flow 'volume_create_manager' (beefeab8-b498-4854-8b47-d14155b17408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5568d595-ad45-422e-b517-afdc5662a091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5568d595-ad45-422e-b517-afdc5662a091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108672556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a13b940-f561-46b4-b3e0-b9f475c77b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951d8710de6047ffb6ba1ebfbf62ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:01Z,use_quota=True,user_id='a1e9ae2104c44f679f509d3bddedc424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c18a8e9-bb0b-42a7-b112-c33b5b5bbc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c18a8e9-bb0b-42a7-b112-c33b5b5bbc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0716456-2490-468a-94f2-edf443e84966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0716456-2490-468a-94f2-edf443e84966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a13b940-f561-46b4-b3e0-b9f475c77b5d', 'volume_name': 'volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a062ffe7-410b-4f99-914f-0039746189f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a062ffe7-410b-4f99-914f-0039746189f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbd08ab-189f-455b-b6e3-a4ec800de406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:01 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Volume 7a13b940-f561-46b4-b3e0-b9f475c77b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d', 'volume_size': 1} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108672556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a13b940-f561-46b4-b3e0-b9f475c77b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951d8710de6047ffb6ba1ebfbf62ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:01Z,use_quota=True,user_id='a1e9ae2104c44f679f509d3bddedc424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Creating volume 7a13b940-f561-46b4-b3e0-b9f475c77b5d {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:27:01 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:01 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d 1073741824 Sep 01 01:27:01 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (63cf1ba0-4393-431e-a9fb-86013046203d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4b56db-a6da-4640-8381-5bb2c911f85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4b56db-a6da-4640-8381-5bb2c911f85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478311496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4484fc-6b75-48ba-a6e6-8b84e61a82f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:02Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb8f778-f4ad-40e4-b6d2-134d9c23f1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb8f778-f4ad-40e4-b6d2-134d9c23f1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f069d16-c0d3-478a-bbbb-3ab1cd80dda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f069d16-c0d3-478a-bbbb-3ab1cd80dda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4484fc-6b75-48ba-a6e6-8b84e61a82f5', 'volume_name': 'volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a589141-eb4e-42f3-80cc-73d6f6b46fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a589141-eb4e-42f3-80cc-73d6f6b46fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07c528a-ccf9-4dcb-9163-41b09de2f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:01 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Volume 7c4484fc-6b75-48ba-a6e6-8b84e61a82f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5', 'volume_size': 1} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:01 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d 1073741824" returned: 0 in 0.437s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:01 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:01 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d Sep 01 01:27:01 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:02 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d" returned: 0 in 0.235s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478311496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4484fc-6b75-48ba-a6e6-8b84e61a82f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:02Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Creating volume 7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:27:02 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbd08ab-189f-455b-b6e3-a4ec800de406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:02 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 1073741824 Sep 01 01:27:02 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ff9713-01b8-4d1f-a660-f04280599b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:02 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Volume volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d (7a13b940-f561-46b4-b3e0-b9f475c77b5d): created successfully Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ff9713-01b8-4d1f-a660-f04280599b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Flow 'volume_create_manager' (beefeab8-b498-4854-8b47-d14155b17408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-41634ab8-141f-4254-b1d3-c1c43b3567d2 tempest-ProjectReaderTests-962163239 None] Created volume successfully. Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Acquiring lock "cinder-7a13b940-f561-46b4-b3e0-b9f475c77b5d-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Lock "cinder-7a13b940-f561-46b4-b3e0-b9f475c77b5d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Acquiring lock "cinder-quobyte-7a13b940-f561-46b4-b3e0-b9f475c77b5d" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Lock "cinder-quobyte-7a13b940-f561-46b4-b3e0-b9f475c77b5d" acquired by "delete_volume" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[671f3068-121a-4a93-8e1c-7869552976d5]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:02 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 1073741824" returned: 0 in 0.466s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:02 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d Sep 01 01:27:02 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:02 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 Sep 01 01:27:02 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:02 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d" returned: 0 in 0.391s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:02 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5" returned: 0 in 0.258s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:02 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d Sep 01 01:27:02 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07c528a-ccf9-4dcb-9163-41b09de2f022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d315d025-46cd-460a-b5c8-14c33b412d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:02 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Volume volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 (7c4484fc-6b75-48ba-a6e6-8b84e61a82f5): created successfully Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d315d025-46cd-460a-b5c8-14c33b412d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:02 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (63cf1ba0-4393-431e-a9fb-86013046203d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:02 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7ba6ca17-af59-43a4-8a24-7705df3fd7ca tempest-ProjectMemberTests-2018568708 None] Created volume successfully. Sep 01 01:27:03 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7a13b940-f561-46b4-b3e0-b9f475c77b5d" returned: 0 in 0.240s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Lock "cinder-quobyte-7a13b940-f561-46b4-b3e0-b9f475c77b5d" released by "delete_volume" :: held 0.672s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Created reservations ['e923d769-0824-47c1-9381-c0beaaee8c9f', 'ea7fba8c-591d-40e5-a9aa-3248d2b8746a', 'b701a419-7d00-4325-9ab6-9d016057ab46', 'd5e5e05f-5652-46a7-a7e8-d81f5a715ad3'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:03 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:27:03 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:03 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.249s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:27:03 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Deleted volume successfully. Sep 01 01:27:03 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-19a6db1c-830e-455c-8e7f-6fef1465d962 tempest-ProjectReaderTests-962163239 None] Lock "cinder-7a13b940-f561-46b4-b3e0-b9f475c77b5d-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Flow 'volume_create_manager' (249d12c5-e739-4b59-a85d-8fa245b1900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86b1c23-c685-4061-b521-c3de1d72d1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] Creating offline snapshot 5a0389fe-0b2f-4a52-9329-67f7981eed48 of volume 7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86b1c23-c685-4061-b521-c3de1d72d1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1869158426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9e495d-0b75-4c28-b08d-f08c2bec01f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951d8710de6047ffb6ba1ebfbf62ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:04Z,use_quota=True,user_id='a1e9ae2104c44f679f509d3bddedc424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09bda8d-dc18-4db2-8b02-9692ebd9df1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09bda8d-dc18-4db2-8b02-9692ebd9df1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b996fc7c-9c69-41f1-a034-93b95a7d5c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b996fc7c-9c69-41f1-a034-93b95a7d5c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9e495d-0b75-4c28-b08d-f08c2bec01f3', 'volume_name': 'volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f75fd8-5e78-42ab-ac42-e355362c54a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f75fd8-5e78-42ab-ac42-e355362c54a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a262d612-e935-40a2-8a0c-66a046b5f7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:04 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Volume dd9e495d-0b75-4c28-b08d-f08c2bec01f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3', 'volume_size': 1} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cda9f0-8b54-4619-9d69-ffd7c025687d]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:04 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 Sep 01 01:27:04 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:04 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5" returned: 0 in 0.353s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:04 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 1G Sep 01 01:27:04 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:04 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 1G" returned: 0 in 0.385s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:04 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:04 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 Sep 01 01:27:04 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:05 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48" returned: 0 in 0.269s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:05 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 is being set with open permissions: ugo+rw Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:05 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 Sep 01 01:27:05 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:05 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48" returned: 0 in 0.251s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:05 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.info Sep 01 01:27:05 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:05 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.info" returned: 0 in 0.247s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:05 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.info is being set with open permissions: ugo+rw Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:05 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.info Sep 01 01:27:05 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:05 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.info" returned: 0 in 0.228s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.782s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1869158426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9e495d-0b75-4c28-b08d-f08c2bec01f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951d8710de6047ffb6ba1ebfbf62ad1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:04Z,use_quota=True,user_id='a1e9ae2104c44f679f509d3bddedc424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Creating volume dd9e495d-0b75-4c28-b08d-f08c2bec01f3 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:27:05 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:27:05 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:05 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3 1073741824 Sep 01 01:27:05 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:05 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-2a09de7a-6764-4f80-a336-33b90af0e71a tempest-ProjectMemberTests-2018568708 None] Create snapshot completed successfully Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-5a0389fe-0b2f-4a52-9329-67f7981eed48-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-5a0389fe-0b2f-4a52-9329-67f7981eed48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-5a0389fe-0b2f-4a52-9329-67f7981eed48" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-5a0389fe-0b2f-4a52-9329-67f7981eed48" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Deleting offline snapshot 5a0389fe-0b2f-4a52-9329-67f7981eed48 of volume 7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] snapshot_file for this snap is: volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed93ce-c251-4f9e-8eab-9c0e7dfdc078]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:06 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 Sep 01 01:27:06 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:06 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3 1073741824" returned: 0 in 0.454s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:06 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3 Sep 01 01:27:06 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:06 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48" returned: 0 in 0.398s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7856a8bc-0b19-4b33-9376-3899ba4da3b6]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:06 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3" returned: 0 in 0.255s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a262d612-e935-40a2-8a0c-66a046b5f7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65257c12-89d8-44fd-9b69-f80a73147eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:06 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Volume volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3 (dd9e495d-0b75-4c28-b08d-f08c2bec01f3): created successfully Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65257c12-89d8-44fd-9b69-f80a73147eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Flow 'volume_create_manager' (249d12c5-e739-4b59-a85d-8fa245b1900e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:06 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a3f81411-2558-4dd4-8ea9-fa59da6003ab tempest-ProjectReaderTests-962163239 None] Created volume successfully. Sep 01 01:27:06 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 Sep 01 01:27:06 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:06 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5" returned: 0 in 0.360s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:06 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:07 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 Sep 01 01:27:07 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Acquiring lock "cinder-dd9e495d-0b75-4c28-b08d-f08c2bec01f3-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Lock "cinder-dd9e495d-0b75-4c28-b08d-f08c2bec01f3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Acquiring lock "cinder-quobyte-dd9e495d-0b75-4c28-b08d-f08c2bec01f3" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Lock "cinder-quobyte-dd9e495d-0b75-4c28-b08d-f08c2bec01f3" acquired by "delete_volume" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddb23dd-c4e0-4d6e-b8ee-83a3bda91bac]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:07 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48" returned: 0 in 0.357s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:07 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48 Sep 01 01:27:07 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:07 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3 Sep 01 01:27:07 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:07 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5.5a0389fe-0b2f-4a52-9329-67f7981eed48" returned: 0 in 0.275s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-5a0389fe-0b2f-4a52-9329-67f7981eed48" released by "_delete_snapshot" :: held 1.483s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:07 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5" released by "delete_snapshot" :: held 1.510s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3" returned: 0 in 0.394s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:07 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3 Sep 01 01:27:07 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Created reservations ['84c828d6-5a17-4e36-8e0b-df2f231a3276', 'efc0d99d-d152-4acc-9f85-7bd398147c37', '77fd4836-748b-424c-bd75-45ee78e2a8a8', 'df1252b3-2d86-4d18-8783-acff9eb04d1b'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:27:07 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Delete snapshot completed successfully. Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-833b427b-9f51-4ef4-906d-cde3199b2c93 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-5a0389fe-0b2f-4a52-9329-67f7981eed48-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:07 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-dd9e495d-0b75-4c28-b08d-f08c2bec01f3" returned: 0 in 0.256s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Lock "cinder-quobyte-dd9e495d-0b75-4c28-b08d-f08c2bec01f3" released by "delete_volume" :: held 0.686s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:07 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Created reservations ['66418180-9d55-4aff-b7ce-95f45409a9be', '275df01c-6032-4840-9cb4-ab769a6b0d3a', '7538561c-95a2-4e56-a326-f7e35d103ddf', '35af0a56-f98e-4fa5-8334-a0118a9491e2'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:08 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:27:08 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:08 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.247s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:27:08 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Deleted volume successfully. Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-e279a539-29c0-45f9-a0d6-9856bffad845 tempest-ProjectReaderTests-962163239 None] Lock "cinder-dd9e495d-0b75-4c28-b08d-f08c2bec01f3-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5" acquired by "delete_volume" :: waited 0.016s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f88d2e1-507f-4ddc-9b9e-304414801711]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:08 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 Sep 01 01:27:08 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:08 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5" returned: 0 in 0.389s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:08 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:08 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5 Sep 01 01:27:08 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:09 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5" returned: 0 in 0.245s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5" released by "delete_volume" :: held 0.685s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Created reservations ['2a8a3c2a-f77b-41ec-a6c1-63ba4318231c', 'fb8238bc-74d8-48a0-8b54-eca42793e1d2', 'aa39642a-49d4-4aea-8a32-ab4e7b457446', 'bcd667d0-bbd4-4327-b506-da0d05c0518c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:09 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:27:09 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:09 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.256s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:27:09 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Deleted volume successfully. Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-f0017a1a-ebe8-4fd4-a0d6-cf5d517b3094 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-7c4484fc-6b75-48ba-a6e6-8b84e61a82f5-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (359a8def-054b-457d-aec3-ea9e9e4e3218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c273db3c-9216-4027-9e4c-b881dd1cf9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c273db3c-9216-4027-9e4c-b881dd1cf9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334338949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c991255a-83a4-41ab-b84c-4f73ae7ece5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:10Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:09 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63667bf9-eccb-4f86-8378-968e136f858c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63667bf9-eccb-4f86-8378-968e136f858c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3436fcf3-6d27-49e2-9437-9b429ec95f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3436fcf3-6d27-49e2-9437-9b429ec95f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c991255a-83a4-41ab-b84c-4f73ae7ece5b', 'volume_name': 'volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea754dc6-ec25-47fc-a9f7-74eeadd6154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea754dc6-ec25-47fc-a9f7-74eeadd6154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631af122-1f11-4401-8f8f-47463a58354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:10 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Volume c991255a-83a4-41ab-b84c-4f73ae7ece5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b', 'volume_size': 1} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334338949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c991255a-83a4-41ab-b84c-4f73ae7ece5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6426a466375e4e4aa4eae923279369d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:10Z,use_quota=True,user_id='8002eaaa87724c26b14fac8fb119a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Creating volume c991255a-83a4-41ab-b84c-4f73ae7ece5b {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:27:10 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:10 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b 1073741824 Sep 01 01:27:10 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:10 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b 1073741824" returned: 0 in 0.398s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:10 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b Sep 01 01:27:10 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:10 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b" returned: 0 in 0.245s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631af122-1f11-4401-8f8f-47463a58354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653ca15d-0a81-4976-bae7-23eba1d75aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:10 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Volume volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b (c991255a-83a4-41ab-b84c-4f73ae7ece5b): created successfully Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653ca15d-0a81-4976-bae7-23eba1d75aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:10 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Flow 'volume_create_manager' (359a8def-054b-457d-aec3-ea9e9e4e3218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:10 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-a144ded0-bb70-400a-bac9-5e557bab2907 tempest-ProjectMemberTests-2018568708 None] Created volume successfully. Sep 01 01:27:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:11 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] Creating offline snapshot f792a4e1-48c0-4a88-985f-b85a1220ed89 of volume c991255a-83a4-41ab-b84c-4f73ae7ece5b {{(pid=87064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:27:11 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b82711-6fd9-4809-a6f2-c599114a3353]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:11 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b Sep 01 01:27:11 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:11 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b" returned: 0 in 0.354s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 1G {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:11 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 1G Sep 01 01:27:11 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:11 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 1G" returned: 0 in 0.384s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:11 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:11 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 Sep 01 01:27:11 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:12 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b -F qcow2 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89" returned: 0 in 0.276s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:12 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 is being set with open permissions: ugo+rw Sep 01 01:27:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:12 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 Sep 01 01:27:12 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:12 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89" returned: 0 in 0.230s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:12 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.info Sep 01 01:27:12 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:12 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.info" returned: 0 in 0.275s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:12 devstack cinder-volume[87064]: WARNING cinder.volume.drivers.remotefs [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.info is being set with open permissions: ugo+rw Sep 01 01:27:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.info {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:12 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.info Sep 01 01:27:12 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:12 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.info" returned: 0 in 0.231s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:12 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:12 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-f6077873-f634-44a5-a617-a184cc98d3e7 tempest-ProjectMemberTests-2018568708 None] Create snapshot completed successfully Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-f792a4e1-48c0-4a88-985f-b85a1220ed89-delete_snapshot" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-f792a4e1-48c0-4a88-985f-b85a1220ed89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-c991255a-83a4-41ab-b84c-4f73ae7ece5b" by "delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-c991255a-83a4-41ab-b84c-4f73ae7ece5b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-f792a4e1-48c0-4a88-985f-b85a1220ed89" by "_delete_snapshot" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-f792a4e1-48c0-4a88-985f-b85a1220ed89" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Deleting offline snapshot f792a4e1-48c0-4a88-985f-b85a1220ed89 of volume c991255a-83a4-41ab-b84c-4f73ae7ece5b {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] snapshot_file for this snap is: volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 {{(pid=87064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[170b8b35-3d9e-4a9c-af07-4a2eb20e2b20]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:13 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 Sep 01 01:27:13 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:13 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89" returned: 0 in 0.359s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8cde18-b7d4-4903-a3fa-722bc5bc7eef]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:13 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:13 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b Sep 01 01:27:13 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:14 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b" returned: 0 in 0.346s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:14 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 Sep 01 01:27:14 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:14 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89" returned: 0 in 0.345s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:14 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89 Sep 01 01:27:14 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:14 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:14 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b.f792a4e1-48c0-4a88-985f-b85a1220ed89" returned: 0 in 0.275s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-f792a4e1-48c0-4a88-985f-b85a1220ed89" released by "_delete_snapshot" :: held 1.412s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-c991255a-83a4-41ab-b84c-4f73ae7ece5b" released by "delete_snapshot" :: held 1.434s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:14 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Created reservations ['e8ae3497-20a3-4f45-b810-09b7ade6117f', 'c4b75742-0ade-4bf8-9bd4-39f52f394ae7', '46dc984b-f40a-4ca4-843a-138b5e4bb281', 'ff6557ab-1398-4028-abcf-f8262f23f40d'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:27:14 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Delete snapshot completed successfully. Sep 01 01:27:14 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-11b9c257-b8bd-4fb5-a888-cd6abdb02718 tempest-ProjectMemberTests-2018568708 None] Lock "cinder-f792a4e1-48c0-4a88-985f-b85a1220ed89-delete_snapshot" released by "delete_snapshot" :: held 1.574s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-c991255a-83a4-41ab-b84c-4f73ae7ece5b-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Lock "cinder-c991255a-83a4-41ab-b84c-4f73ae7ece5b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Acquiring lock "cinder-quobyte-c991255a-83a4-41ab-b84c-4f73ae7ece5b" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:15 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-c991255a-83a4-41ab-b84c-4f73ae7ece5b" acquired by "delete_volume" :: waited 0.013s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:15 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda2214c-be79-4b25-a656-3eae56b80712]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:15 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b Sep 01 01:27:15 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:15 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b" returned: 0 in 0.347s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:15 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:15 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b Sep 01 01:27:15 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:16 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-c991255a-83a4-41ab-b84c-4f73ae7ece5b" returned: 0 in 0.234s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Lock "cinder-quobyte-c991255a-83a4-41ab-b84c-4f73ae7ece5b" released by "delete_volume" :: held 0.644s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Created reservations ['0dc51036-772a-429c-8d90-35e8a94fe0bf', 'df724be7-59ec-4dc3-bf01-97708cbfb25c', '81cb646b-9a89-47d6-8c52-7f22bcb01900', '654a125e-ca40-454d-bc63-a66f803c3672'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:16 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:27:16 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:16 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.239s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:27:16 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Deleted volume successfully. Sep 01 01:27:16 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-952322c2-c6d3-4664-b1d7-9b47fc8a488c tempest-ProjectMemberTests-2018568708 None] Lock "cinder-c991255a-83a4-41ab-b84c-4f73ae7ece5b-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Flow 'volume_create_manager' (68722f7d-8780-4ae6-9152-38cc59ef8cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df08beeb-c15b-4bb4-b69e-684a8edd4f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df08beeb-c15b-4bb4-b69e-684a8edd4f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433837651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c4745a-f573-45f9-a7a8-3fb7795de051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d8df6f056a45f284441c360361e940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:20Z,use_quota=True,user_id='beb8c73d83ac4438a5ba0694226d1143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24f00b1-e61b-48c1-baed-af9d650ba452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24f00b1-e61b-48c1-baed-af9d650ba452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e3bdcc-bc72-4571-8ca9-b5a91c86ccaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e3bdcc-bc72-4571-8ca9-b5a91c86ccaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c4745a-f573-45f9-a7a8-3fb7795de051', 'volume_name': 'volume-a5c4745a-f573-45f9-a7a8-3fb7795de051', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4261ee-f105-4257-8474-2585f263adcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4261ee-f105-4257-8474-2585f263adcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ecfbf1-2a58-4cf0-b759-f3a2afdfa8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:20 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Volume a5c4745a-f573-45f9-a7a8-3fb7795de051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c4745a-f573-45f9-a7a8-3fb7795de051', 'volume_size': 1} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433837651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c4745a-f573-45f9-a7a8-3fb7795de051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d8df6f056a45f284441c360361e940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:20Z,use_quota=True,user_id='beb8c73d83ac4438a5ba0694226d1143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Creating volume a5c4745a-f573-45f9-a7a8-3fb7795de051 {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:27:20 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:20 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051 1073741824 Sep 01 01:27:20 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:20 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051 1073741824" returned: 0 in 0.472s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:20 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:20 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051 Sep 01 01:27:20 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:21 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051" returned: 0 in 0.262s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:21 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:27:21 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ecfbf1-2a58-4cf0-b759-f3a2afdfa8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c4745a-f573-45f9-a7a8-3fb7795de051', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455d234c-2876-4b3c-a851-54472d4e930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:21 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Volume volume-a5c4745a-f573-45f9-a7a8-3fb7795de051 (a5c4745a-f573-45f9-a7a8-3fb7795de051): created successfully Sep 01 01:27:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455d234c-2876-4b3c-a851-54472d4e930e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:21 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Flow 'volume_create_manager' (68722f7d-8780-4ae6-9152-38cc59ef8cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:21 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-9262b546-3ef6-48c8-a37d-5989357b179c tempest-ProjectReaderTests-327774887 None] Created volume successfully. Sep 01 01:27:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Acquiring lock "cinder-a5c4745a-f573-45f9-a7a8-3fb7795de051-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Lock "cinder-a5c4745a-f573-45f9-a7a8-3fb7795de051-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Acquiring lock "cinder-quobyte-a5c4745a-f573-45f9-a7a8-3fb7795de051" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:22 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Lock "cinder-quobyte-a5c4745a-f573-45f9-a7a8-3fb7795de051" acquired by "delete_volume" :: waited 0.014s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:22 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e87a4db-b791-4422-81a2-4b1da19e402c]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:22 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:22 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051 Sep 01 01:27:22 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:23 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051" returned: 0 in 0.349s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:23 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051 Sep 01 01:27:23 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:23 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-a5c4745a-f573-45f9-a7a8-3fb7795de051" returned: 0 in 0.236s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Lock "cinder-quobyte-a5c4745a-f573-45f9-a7a8-3fb7795de051" released by "delete_volume" :: held 0.627s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Created reservations ['3cf11979-2a37-4776-a00b-4bc5102ab352', '6151be93-7c93-4ad5-bd4c-2d60b9e887ca', 'b3d8c2ad-fa2a-4b22-87bd-d3d79cf25b08', '58b142ef-747b-472f-a441-f018e37bdf7a'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:23 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:27:23 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:23 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.244s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:27:23 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Deleted volume successfully. Sep 01 01:27:23 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-7216db5b-ce03-4148-adcd-c5d7e5d4cc02 tempest-ProjectReaderTests-327774887 None] Lock "cinder-a5c4745a-f573-45f9-a7a8-3fb7795de051-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.flows.manager.create_volume [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Flow 'volume_create_manager' (62ed9dfe-9a5e-481c-ab55-15a8235646af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c31c53-a780-49ae-97df-a760c0226f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c31c53-a780-49ae-97df-a760c0226f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203455921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7395974-a657-4962-ae72-ee45e55c4a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d8df6f056a45f284441c360361e940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:24Z,use_quota=True,user_id='beb8c73d83ac4438a5ba0694226d1143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133e4a81-1b6e-4221-9225-342038dd706b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133e4a81-1b6e-4221-9225-342038dd706b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1da28e8-456e-487e-9567-8b2053b59a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1da28e8-456e-487e-9567-8b2053b59a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7395974-a657-4962-ae72-ee45e55c4a3a', 'volume_name': 'volume-e7395974-a657-4962-ae72-ee45e55c4a3a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89fe0c8-e9dd-411b-a9b2-4ddf1909f159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89fe0c8-e9dd-411b-a9b2-4ddf1909f159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d25be06-71b0-4471-b691-54fd447a9f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:24 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Volume e7395974-a657-4962-ae72-ee45e55c4a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7395974-a657-4962-ae72-ee45e55c4a3a', 'volume_size': 1} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203455921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7395974-a657-4962-ae72-ee45e55c4a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d8df6f056a45f284441c360361e940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:27:24Z,use_quota=True,user_id='beb8c73d83ac4438a5ba0694226d1143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154515dd-c515-41f1-a70a-da43f0c9b293),volume_type_id=154515dd-c515-41f1-a70a-da43f0c9b293)}" {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.remotefs [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Creating volume e7395974-a657-4962-ae72-ee45e55c4a3a {{(pid=87064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Selected osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 as target Quobyte volume. {{(pid=87064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:27:24 devstack cinder-volume[87064]: INFO cinder.volume.drivers.remotefs [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] casted to osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52 Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a 1073741824 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:24 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a 1073741824 Sep 01 01:27:24 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:24 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a 1073741824" returned: 0 in 0.426s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:24 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a Sep 01 01:27:24 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:24 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a" returned: 0 in 0.246s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'} {{(pid=87064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d25be06-71b0-4471-b691-54fd447a9f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7395974-a657-4962-ae72-ee45e55c4a3a', 'volume_size': 1}' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d793973d-1347-465e-9c47-d0e9687ce3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:27:24 devstack cinder-volume[87064]: INFO cinder.volume.flows.manager.create_volume [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Volume volume-e7395974-a657-4962-ae72-ee45e55c4a3a (e7395974-a657-4962-ae72-ee45e55c4a3a): created successfully Sep 01 01:27:24 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d793973d-1347-465e-9c47-d0e9687ce3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Flow 'volume_create_manager' (62ed9dfe-9a5e-481c-ab55-15a8235646af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:27:25 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-089e0e35-c0b8-4c49-bfad-6ff1df931079 tempest-ProjectReaderTests-327774887 None] Created volume successfully. Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Acquiring lock "cinder-e7395974-a657-4962-ae72-ee45e55c4a3a-delete_volume" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Lock "cinder-e7395974-a657-4962-ae72-ee45e55c4a3a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Acquiring lock "cinder-quobyte-e7395974-a657-4962-ae72-ee45e55c4a3a" by "delete_volume" {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Lock "cinder-quobyte-e7395974-a657-4962-ae72-ee45e55c4a3a" acquired by "delete_volume" :: waited 0.017s {{(pid=87064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8ad8f7-2212-41c8-844d-4d702ea90375]: (4, 'qcow2') {{(pid=88338) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:25 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a Sep 01 01:27:25 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:25 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a" returned: 0 in 0.359s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:25 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a Sep 01 01:27:25 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:25 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292/volume-e7395974-a657-4962-ae72-ee45e55c4a3a" returned: 0 in 0.244s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Lock "cinder-quobyte-e7395974-a657-4962-ae72-ee45e55c4a3a" released by "delete_volume" :: held 0.644s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:25 devstack cinder-volume[87064]: DEBUG cinder.quota [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Created reservations ['184bc8a2-b48a-439f-9da1-0b4e4fe8b949', '3e796676-0cbc-4a4f-9357-511eb0c2daec', 'e0e7eeb6-e15b-4d84-9da5-c07014fef841', '3665c45d-30a4-42a0-9f6d-b595609d923c'] {{(pid=87064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:27:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:26 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:26 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:27:26 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:26 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:26 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.259s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:26 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:27:26 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Deleted volume successfully. Sep 01 01:27:26 devstack cinder-volume[87064]: DEBUG cinder.coordination [None req-275a49aa-9620-4052-8de3-b87e630b3587 tempest-ProjectReaderTests-327774887 None] Lock "cinder-e7395974-a657-4962-ae72-ee45e55c4a3a-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=87064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:27:36 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=137,cinder:UPDATE=164,cinder:INSERT=44,cinder:DELETE=12 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:27:42 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=107,cinder:UPDATE=175,cinder:INSERT=44,cinder:DELETE=16 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:27:52 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:27:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:27:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:27:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52': None} {{(pid=87064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:27:52 devstack cinder-volume[87064]: DEBUG cinder.volume.drivers.quobyte [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-008b07f4-3c44-4c32-ad2a-ec78953eee52'] {{(pid=87064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:27:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:27:52 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:27:52 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292 Sep 01 01:27:52 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:27:53 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Sep 01 01:27:53 devstack cinder-volume[87064]: DEBUG oslo_concurrency.processutils [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e4085fdf8a02bc829520b81419ce1292" returned: 0 in 0.288s {{(pid=87064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:27:53 devstack cinder-volume[87064]: DEBUG cinder.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Notifying Schedulers of capabilities ... {{(pid=87064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:27:53 devstack cinder-volume[87064]: DEBUG oslo_service.periodic_task [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:27:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread count: 29 {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:27:53 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6a5084d7-11b0-41ea-b0c7-360e472b58a0 None None] thread info: [<_MainThread(MainThread, started 127631455936640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}